Jul 10 18:58:00.138481 ip-10-0-134-251 systemd[1]: Starting Kubernetes Kubelet... Jul 10 18:58:00.527674 ip-10-0-134-251 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:58:00.527674 ip-10-0-134-251 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 18:58:00.527674 ip-10-0-134-251 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:58:00.527674 ip-10-0-134-251 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 18:58:00.527674 ip-10-0-134-251 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:58:00.529528 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.529434 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 18:58:00.533754 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533738 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:58:00.533785 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533754 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:58:00.533785 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533759 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:58:00.533785 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533763 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:58:00.533785 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533767 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:58:00.533785 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533771 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:58:00.533785 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533781 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:58:00.533785 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533786 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533789 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533793 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533797 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533800 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533805 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533809 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533813 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533817 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533820 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533824 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533828 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533832 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533835 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533839 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533843 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533847 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533850 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533854 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533857 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:58:00.533946 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533861 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533865 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533868 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533871 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533875 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533878 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533882 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533886 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533889 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533894 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533897 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533900 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533904 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533908 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533913 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533916 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533920 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533924 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533927 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533931 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:58:00.534417 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533935 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533938 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533942 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533945 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533949 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533952 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533955 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533959 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533963 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533967 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533970 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533973 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533980 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533985 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533988 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533993 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.533997 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534002 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534009 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:58:00.534876 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534014 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534019 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534023 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534026 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534030 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534034 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534039 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534045 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534049 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534052 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534056 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534060 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534064 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534067 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534071 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534074 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534078 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534081 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534085 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534088 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:58:00.535310 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534092 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534096 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534099 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534102 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534106 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534109 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534114 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534117 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534120 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534123 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534127 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534130 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.534134 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535077 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535087 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535092 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535096 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535101 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535106 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:58:00.535762 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535112 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535117 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535121 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535125 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535129 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535132 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535136 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535140 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535144 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535147 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535150 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535154 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535157 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535161 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535164 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535168 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535172 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535175 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535180 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:58:00.536195 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535185 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535189 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535193 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535197 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535200 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535203 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535207 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535211 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535214 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535219 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535224 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535242 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535246 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535251 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535255 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535259 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535262 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535265 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535269 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:58:00.536690 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535273 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535276 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535280 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535284 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535287 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535290 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535294 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535297 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535301 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535305 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535308 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535312 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535315 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535318 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535322 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535325 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535330 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535334 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535338 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535341 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535345 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:58:00.537133 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535348 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535352 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535355 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535358 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535381 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535387 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535392 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535397 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535401 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535405 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535409 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535412 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535416 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535419 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535423 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535427 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535431 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535434 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535437 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:58:00.537635 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535441 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535444 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535448 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535451 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535455 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535459 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535463 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535467 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535470 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535474 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535478 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535482 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535486 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535489 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535493 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535975 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535982 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535985 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535990 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535994 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:58:00.538068 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.535998 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536002 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536006 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536010 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536013 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536016 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536020 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536023 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536027 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536038 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536041 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536044 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536048 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536051 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536055 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536062 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536066 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536070 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536075 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536079 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:58:00.538578 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536083 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536087 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536091 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536095 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536098 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536102 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536105 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536109 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536112 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536116 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536120 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536124 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536127 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536132 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536136 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536139 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536143 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536146 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536149 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536153 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:58:00.539033 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536157 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536160 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536163 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536167 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536170 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536173 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536177 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536181 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536184 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536188 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536191 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536194 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536198 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536201 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536205 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536210 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536215 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536218 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536222 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536226 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:58:00.539514 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536243 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536247 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536251 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536255 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536258 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536262 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536266 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536270 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536274 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536277 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536282 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536287 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536292 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536295 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536299 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536303 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536306 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536309 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536313 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:58:00.540015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536317 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536321 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536324 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536328 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536331 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536335 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536339 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536343 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536347 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536350 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536354 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536358 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536361 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536365 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.536369 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536455 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536472 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536479 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536485 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536490 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536495 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 18:58:00.540473 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536501 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536506 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536511 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536515 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536519 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536523 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536527 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536532 2555 flags.go:64] FLAG: --cgroup-root="" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536536 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536539 2555 flags.go:64] FLAG: --client-ca-file="" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536543 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536547 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536554 2555 flags.go:64] FLAG: --cluster-domain="" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536557 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536562 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536566 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536570 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536575 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536584 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536589 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536593 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536597 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536601 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536606 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 18:58:00.540973 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536610 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536614 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536619 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536623 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536627 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536631 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536635 2555 flags.go:64] FLAG: --enable-server="true" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536639 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536645 2555 flags.go:64] FLAG: --event-burst="100" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536650 2555 flags.go:64] FLAG: --event-qps="50" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536654 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536658 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536662 2555 flags.go:64] FLAG: --eviction-hard="" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536667 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536672 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536676 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536680 2555 flags.go:64] FLAG: --eviction-soft="" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536684 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536691 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536695 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536699 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536703 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536707 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536711 2555 flags.go:64] FLAG: --feature-gates="" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536717 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 18:58:00.541540 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536721 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536726 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536731 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536735 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536739 2555 flags.go:64] FLAG: --help="false" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536743 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-134-251.ec2.internal" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536748 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536751 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536755 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536760 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536765 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536769 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536773 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536778 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536782 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536786 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536791 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536795 2555 flags.go:64] FLAG: --kube-reserved="" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536798 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536802 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536807 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536811 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536815 2555 flags.go:64] FLAG: --lock-file="" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536818 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 18:58:00.542130 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536822 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536827 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536835 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536839 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536842 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536846 2555 flags.go:64] FLAG: --logging-format="text" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536849 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536854 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536858 2555 flags.go:64] FLAG: --manifest-url="" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536863 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536868 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536873 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536878 2555 flags.go:64] FLAG: --max-pods="110" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536882 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536886 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536890 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536894 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536899 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536903 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536907 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536915 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536919 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536924 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 18:58:00.542703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536929 2555 flags.go:64] FLAG: --pod-cidr="" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536933 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536940 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536945 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536949 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536953 2555 flags.go:64] FLAG: --port="10250" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536957 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536961 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f02b75ca193bdfbc" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536965 2555 flags.go:64] FLAG: --qos-reserved="" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536969 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536974 2555 flags.go:64] FLAG: --register-node="true" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536979 2555 flags.go:64] FLAG: --register-with-taints="" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536984 2555 flags.go:64] FLAG: --registry-burst="10" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536988 2555 flags.go:64] FLAG: --registry-qps="5" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536992 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.536996 2555 flags.go:64] FLAG: --reserved-memory="" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537001 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537005 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537009 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537014 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537018 2555 flags.go:64] FLAG: --runonce="false" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537022 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537026 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537030 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537035 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 18:58:00.543243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537038 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537042 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537046 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537050 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537054 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537058 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537062 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537066 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537070 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537075 2555 flags.go:64] FLAG: --system-cgroups="" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537080 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537087 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537090 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537094 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537100 2555 flags.go:64] FLAG: --tls-min-version="" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537104 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537108 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537113 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537118 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537122 2555 flags.go:64] FLAG: --v="2" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537127 2555 flags.go:64] FLAG: --version="false" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537132 2555 flags.go:64] FLAG: --vmodule="" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537137 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.537141 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537303 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:58:00.543837 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537309 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537316 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537320 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537324 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537329 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537333 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537337 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537341 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537344 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537348 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537351 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537355 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537358 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537362 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537366 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537369 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537372 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537376 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537380 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537386 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:58:00.544491 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537391 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537394 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537398 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537401 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537406 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537410 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537414 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537417 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537420 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537424 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537427 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537431 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537435 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537439 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537443 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537446 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537449 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537453 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537457 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537460 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:58:00.545063 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537464 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537467 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537471 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537474 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537478 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537481 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537485 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537489 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537492 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537495 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537499 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537503 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537509 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537514 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537517 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537521 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537526 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537529 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537533 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537536 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:58:00.545713 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537539 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537543 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537546 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537550 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537554 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537559 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537563 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537566 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537570 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537574 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537578 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537582 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537585 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537589 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537593 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537596 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537600 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537603 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537607 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537611 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:58:00.546287 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537614 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537617 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537621 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537624 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537629 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537632 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537636 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537640 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537645 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537648 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537652 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537655 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537659 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537662 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537666 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537669 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537672 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:58:00.546759 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.537679 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:58:00.547159 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.538220 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:58:00.547159 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.546973 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 18:58:00.547159 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.546988 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 18:58:00.547929 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.547918 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 18:58:00.547972 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.547933 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 18:58:00.547999 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.547986 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:58:00.547999 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.547991 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:58:00.547999 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.547996 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:58:00.547999 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548000 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548004 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548007 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548010 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548013 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548015 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548019 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548023 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548025 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548028 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548038 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548042 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548044 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548047 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548050 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548053 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548055 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548057 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548060 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:58:00.548105 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548063 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548065 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548068 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548070 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548073 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548075 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548083 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548087 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548089 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548092 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548094 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548097 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548099 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548102 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548105 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548108 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548111 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548114 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548116 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548120 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:58:00.548572 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548124 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548126 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548129 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548132 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548135 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548138 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548140 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548143 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548145 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548148 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548151 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548153 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548155 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548158 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548160 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548163 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548166 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548168 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548171 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:58:00.549045 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548173 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548176 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548178 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548181 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548183 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548186 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548188 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548191 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548194 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548196 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548199 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548201 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548204 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548206 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548209 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548211 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548214 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548216 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548219 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548221 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:58:00.549496 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548224 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548226 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548242 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548245 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548248 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548251 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548253 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548256 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548258 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548261 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548263 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548266 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548268 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548270 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548273 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548276 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548278 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:58:00.549952 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548281 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.548286 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548397 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548402 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548406 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548409 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548412 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548415 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548418 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548420 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548423 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548425 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548428 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548430 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548434 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:58:00.550365 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548436 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548438 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548440 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548443 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548445 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548448 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548450 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548453 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548455 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548458 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548460 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548462 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548465 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548469 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548473 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548476 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548479 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548482 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548485 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:58:00.550718 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548487 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548490 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548493 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548495 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548498 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548500 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548503 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548505 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548508 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548510 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548513 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548515 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548518 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548521 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548523 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548527 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548530 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548533 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548536 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:58:00.551188 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548539 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548541 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548544 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548547 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548550 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548552 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548555 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548558 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548561 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548563 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548566 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548569 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548573 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548576 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548578 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548581 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548583 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548586 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548589 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548591 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:58:00.551651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548594 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548596 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548598 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548601 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548603 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548606 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548608 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548611 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548613 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548616 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548618 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548620 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548623 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548625 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548628 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548630 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548632 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548634 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548637 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548639 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:58:00.552122 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548642 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548644 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548646 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548649 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548651 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548653 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548656 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:00.548658 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.548663 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.548760 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.550837 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.552260 2555 server.go:1019] "Starting client certificate rotation" Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.552370 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 18:58:00.552681 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.552409 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 18:58:00.554651 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.554639 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 18:58:00.555731 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.555717 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 18:58:00.563818 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.563802 2555 log.go:25] "Validated CRI v1 runtime API" Jul 10 18:58:00.565664 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.565651 2555 log.go:25] "Validated CRI v1 image API" Jul 10 18:58:00.568375 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.568363 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 18:58:00.570525 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.570506 2555 fs.go:135] Filesystem UUIDs: map[4487c721-6a4a-46a5-b8dd-7055c230f0a7:/dev/nvme0n1p3 71d74753-6f05-4411-a1b1-38768855a6ee:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 10 18:58:00.570597 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.570525 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 18:58:00.575008 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.574805 2555 manager.go:216] Machine: {Timestamp:2026-07-10 18:58:00.574290456 +0000 UTC m=+0.326468166 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3207312 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bec00228b6f634bfe9fa23cfba3e7 SystemUUID:ec2bec00-228b-6f63-4bfe-9fa23cfba3e7 BootID:4ed23c9b-1eae-4fe9-93af-250e585d1b2e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5f:b6:1d:41:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5f:b6:1d:41:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:1d:75:2e:e3:85 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 18:58:00.575008 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.575001 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 18:58:00.575166 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.575098 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 18:58:00.578195 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.578165 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 18:58:00.578345 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.578199 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-251.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 18:58:00.579419 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.579406 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 18:58:00.579452 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.579423 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 18:58:00.579452 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.579430 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 18:58:00.580125 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.580115 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 18:58:00.581347 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.581334 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 18:58:00.583906 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.583894 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 10 18:58:00.584017 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.584008 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 18:58:00.584054 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.584047 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 10 18:58:00.584092 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.584059 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 18:58:00.584092 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.584073 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 18:58:00.584092 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.584081 2555 kubelet.go:398] "Adding apiserver pod source" Jul 10 18:58:00.584092 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.584089 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 18:58:00.584431 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.584408 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 18:58:00.584476 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.584433 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 18:58:00.584592 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.584566 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 18:58:00.586633 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.586615 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 18:58:00.588219 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588206 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 18:58:00.588285 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588252 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 18:58:00.588401 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588392 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 18:58:00.588431 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588406 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 18:58:00.588431 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588413 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 18:58:00.588431 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588418 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 18:58:00.588431 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588426 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 18:58:00.588431 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588431 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 18:58:00.588981 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588972 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 18:58:00.588981 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588981 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 18:58:00.589031 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588988 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 18:58:00.589031 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.588993 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 18:58:00.589031 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.589000 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 18:58:00.589031 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.589007 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 18:58:00.589742 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.589732 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 18:58:00.589742 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.589742 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 18:58:00.592840 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.592825 2555 server.go:1268] "Started kubelet" Jul 10 18:58:00.592950 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.592924 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 18:58:00.593071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.593035 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 18:58:00.593146 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.593090 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 18:58:00.593596 ip-10-0-134-251 systemd[1]: Started Kubernetes Kubelet. Jul 10 18:58:00.595003 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.594990 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 10 18:58:00.596285 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.596268 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-251.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 18:58:00.596588 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.596555 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-251.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 18:58:00.596628 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.596558 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 18:58:00.596680 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.596666 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 18:58:00.598084 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.598065 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 18:58:00.601710 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.601696 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 18:58:00.602069 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.601122 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-251.ec2.internal.18c102af971690d0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-251.ec2.internal,UID:ip-10-0-134-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-251.ec2.internal,},FirstTimestamp:2026-07-10 18:58:00.592797904 +0000 UTC m=+0.344975614,LastTimestamp:2026-07-10 18:58:00.592797904 +0000 UTC m=+0.344975614,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-251.ec2.internal,}" Jul 10 18:58:00.602330 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.602317 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 18:58:00.602484 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.602398 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-251.ec2.internal\" not found" Jul 10 18:58:00.602880 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.602861 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 18:58:00.602880 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.602878 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 18:58:00.603048 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.602860 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 18:58:00.603048 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.603026 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 10 18:58:00.603048 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.603036 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 10 18:58:00.603594 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.603580 2555 factory.go:55] Registering systemd factory Jul 10 18:58:00.603594 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.603595 2555 factory.go:223] Registration of the systemd container factory successfully Jul 10 18:58:00.603823 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.603810 2555 factory.go:153] Registering CRI-O factory Jul 10 18:58:00.603883 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.603827 2555 factory.go:223] Registration of the crio container factory successfully Jul 10 18:58:00.603883 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.603870 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 18:58:00.603978 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.603892 2555 factory.go:103] Registering Raw factory Jul 10 18:58:00.603978 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.603907 2555 manager.go:1196] Started watching for new ooms in manager Jul 10 18:58:00.604346 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.604325 2555 manager.go:349] Starting recovery of all containers Jul 10 18:58:00.607743 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.607716 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-251.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 18:58:00.607837 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.607810 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 18:58:00.615537 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.615519 2555 manager.go:354] Recovery completed Jul 10 18:58:00.619189 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.619172 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:58:00.620897 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.620879 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:58:00.620968 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.620912 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:58:00.620968 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.620926 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:58:00.621460 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.621446 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 18:58:00.621460 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.621456 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:58:00.621549 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.621459 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 18:58:00.621549 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.621485 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 10 18:58:00.622067 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.622054 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:58:00.622101 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.622081 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:58:00.622101 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.622094 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:58:00.622630 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.622617 2555 policy_none.go:49] "None policy: Start" Jul 10 18:58:00.622669 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.622636 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 18:58:00.622669 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.622648 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 18:58:00.623372 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.623299 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-251.ec2.internal.18c102af98c35435 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-251.ec2.internal,UID:ip-10-0-134-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-251.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-251.ec2.internal,},FirstTimestamp:2026-07-10 18:58:00.620897333 +0000 UTC m=+0.373075047,LastTimestamp:2026-07-10 18:58:00.620897333 +0000 UTC m=+0.373075047,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-251.ec2.internal,}" Jul 10 18:58:00.623738 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.623724 2555 policy_none.go:47] "Start" Jul 10 18:58:00.633486 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.633425 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-251.ec2.internal.18c102af98c3a8f3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-251.ec2.internal,UID:ip-10-0-134-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-251.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-251.ec2.internal,},FirstTimestamp:2026-07-10 18:58:00.620919027 +0000 UTC m=+0.373096738,LastTimestamp:2026-07-10 18:58:00.620919027 +0000 UTC m=+0.373096738,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-251.ec2.internal,}" Jul 10 18:58:00.645940 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.645805 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l8m9r" Jul 10 18:58:00.645940 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.645801 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-251.ec2.internal.18c102af98c3d99d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-251.ec2.internal,UID:ip-10-0-134-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-251.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-251.ec2.internal,},FirstTimestamp:2026-07-10 18:58:00.620931485 +0000 UTC m=+0.373109199,LastTimestamp:2026-07-10 18:58:00.620931485 +0000 UTC m=+0.373109199,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-251.ec2.internal,}" Jul 10 18:58:00.653917 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.653902 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l8m9r" Jul 10 18:58:00.656096 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.656045 2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-251.ec2.internal.18c102af98c35435\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-251.ec2.internal.18c102af98c35435 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-251.ec2.internal,UID:ip-10-0-134-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-251.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-251.ec2.internal,},FirstTimestamp:2026-07-10 18:58:00.620897333 +0000 UTC m=+0.373075047,LastTimestamp:2026-07-10 18:58:00.622067801 +0000 UTC m=+0.374245515,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-251.ec2.internal,}" Jul 10 18:58:00.659738 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.659725 2555 manager.go:337] "Starting Device Plugin manager" Jul 10 18:58:00.659805 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.659748 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 18:58:00.659805 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.659756 2555 server.go:87] "Starting device plugin registration server" Jul 10 18:58:00.659941 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.659931 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 18:58:00.659979 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.659943 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 18:58:00.660065 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.660043 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 18:58:00.660177 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.660144 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 18:58:00.660177 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.660153 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 18:58:00.660529 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.660512 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 18:58:00.660626 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.660577 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-251.ec2.internal\" not found" Jul 10 18:58:00.712797 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.712777 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 18:58:00.717583 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.714042 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 18:58:00.717583 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.714074 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 18:58:00.717583 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.714091 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 18:58:00.717583 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.714117 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 18:58:00.717583 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.716328 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:58:00.760498 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.760481 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:58:00.761205 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.761190 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:58:00.761286 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.761215 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:58:00.761286 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.761225 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:58:00.761286 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.761265 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-251.ec2.internal" Jul 10 18:58:00.768673 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.768660 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-251.ec2.internal" Jul 10 18:58:00.768718 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.768683 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-251.ec2.internal\": node \"ip-10-0-134-251.ec2.internal\" not found" Jul 10 18:58:00.800593 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.800549 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-251.ec2.internal\" not found" Jul 10 18:58:00.814928 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.814903 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-251.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal"] Jul 10 18:58:00.814990 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.814966 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:58:00.816285 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.816272 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:58:00.816346 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.816294 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:58:00.816346 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.816303 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:58:00.817613 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.817602 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:58:00.817711 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.817692 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-251.ec2.internal" Jul 10 18:58:00.817753 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.817717 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:58:00.818241 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.818209 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:58:00.818318 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.818252 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:58:00.818318 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.818262 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:58:00.818318 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.818274 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:58:00.818318 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.818296 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:58:00.818318 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.818309 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:58:00.819618 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.819602 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" Jul 10 18:58:00.819692 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.819631 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:58:00.820272 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.820257 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:58:00.820360 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.820287 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:58:00.820360 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:00.820302 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:58:00.850811 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.850790 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-251.ec2.internal\" not found" node="ip-10-0-134-251.ec2.internal" Jul 10 18:58:00.856178 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.856162 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-251.ec2.internal\" not found" node="ip-10-0-134-251.ec2.internal" Jul 10 18:58:00.900772 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:00.900753 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-251.ec2.internal\" not found" Jul 10 18:58:01.001517 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.001496 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-251.ec2.internal\" not found" Jul 10 18:58:01.004797 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.004782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec9137c4307049750dc9b17b99b29ee7-config\") pod \"kube-apiserver-proxy-ip-10-0-134-251.ec2.internal\" (UID: \"ec9137c4307049750dc9b17b99b29ee7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.004849 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.004803 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cd3e1ad6699b6d3543e0c80246f16cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal\" (UID: \"2cd3e1ad6699b6d3543e0c80246f16cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.004849 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.004820 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd3e1ad6699b6d3543e0c80246f16cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal\" (UID: \"2cd3e1ad6699b6d3543e0c80246f16cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.102715 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.102695 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-251.ec2.internal\" not found" Jul 10 18:58:01.105060 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.105047 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec9137c4307049750dc9b17b99b29ee7-config\") pod \"kube-apiserver-proxy-ip-10-0-134-251.ec2.internal\" (UID: \"ec9137c4307049750dc9b17b99b29ee7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.105112 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.105067 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cd3e1ad6699b6d3543e0c80246f16cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal\" (UID: \"2cd3e1ad6699b6d3543e0c80246f16cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.105112 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.105085 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd3e1ad6699b6d3543e0c80246f16cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal\" (UID: \"2cd3e1ad6699b6d3543e0c80246f16cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.105112 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.105109 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd3e1ad6699b6d3543e0c80246f16cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal\" (UID: \"2cd3e1ad6699b6d3543e0c80246f16cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.105206 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.105142 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec9137c4307049750dc9b17b99b29ee7-config\") pod \"kube-apiserver-proxy-ip-10-0-134-251.ec2.internal\" (UID: \"ec9137c4307049750dc9b17b99b29ee7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.105206 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.105152 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cd3e1ad6699b6d3543e0c80246f16cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal\" (UID: \"2cd3e1ad6699b6d3543e0c80246f16cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.153380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.153352 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.159723 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.159707 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.203877 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.203854 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-251.ec2.internal\" not found" Jul 10 18:58:01.310362 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.310306 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-251.ec2.internal\" not found" Jul 10 18:58:01.410425 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.410395 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-251.ec2.internal\" not found" Jul 10 18:58:01.510599 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.510563 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-251.ec2.internal\" not found" Jul 10 18:58:01.547728 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.547703 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:58:01.551941 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.551923 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 18:58:01.552056 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.552040 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 18:58:01.552104 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.552082 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 18:58:01.584981 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.584930 2555 apiserver.go:52] "Watching apiserver" Jul 10 18:58:01.602391 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.602370 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 18:58:01.602854 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.602813 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.609533 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.609500 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 18:58:01.611134 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.611105 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-pz6wd","openshift-cluster-node-tuning-operator/tuned-zhj4g","openshift-dns/node-resolver-jfrgv","openshift-multus/multus-additional-cni-plugins-plnr2","openshift-multus/multus-gkj7m","openshift-network-operator/iptables-alerter-t5fwr","kube-system/global-pull-secret-syncer-xxv9h","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s","openshift-image-registry/node-ca-hsg7h","openshift-multus/network-metrics-daemon-4z4gc","openshift-network-diagnostics/network-check-target-dsprs","openshift-ovn-kubernetes/ovnkube-node-29w9l"] Jul 10 18:58:01.612649 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.612626 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:01.613843 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.613823 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.615121 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.615098 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jfrgv" Jul 10 18:58:01.615405 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.615310 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 18:58:01.615405 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.615377 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4n8ln\"" Jul 10 18:58:01.615588 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.615412 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" Jul 10 18:58:01.615588 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.615544 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 18:58:01.615588 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.615547 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 18:58:01.616399 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.616381 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.616721 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.616702 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 18:58:01.616966 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.616950 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pv2jg\"" Jul 10 18:58:01.617046 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.617030 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:58:01.617536 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.617516 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.618086 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.618070 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 18:58:01.618185 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.618170 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8ckt8\"" Jul 10 18:58:01.618538 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.618525 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 18:58:01.618773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.618753 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 18:58:01.618879 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.618798 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 18:58:01.618879 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.618837 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t5fwr" Jul 10 18:58:01.619145 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.619129 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 18:58:01.619209 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.619129 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 18:58:01.619503 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.619486 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 18:58:01.619589 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.619518 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 18:58:01.619589 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.619554 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jtvmh\"" Jul 10 18:58:01.619724 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.619709 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 18:58:01.620098 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.620080 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:01.620176 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.620138 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:01.620525 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.620506 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fdc8w\"" Jul 10 18:58:01.621338 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.621316 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.621443 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.621405 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:58:01.622039 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.622022 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 18:58:01.622129 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.622083 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-clx9t\"" Jul 10 18:58:01.622129 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.622097 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 18:58:01.622628 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.622615 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hsg7h" Jul 10 18:58:01.623975 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.623959 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 18:58:01.624058 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.623986 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 18:58:01.624136 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.624122 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 18:58:01.624328 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.624314 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ld2n4\"" Jul 10 18:58:01.624409 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.624358 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:01.624463 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.624406 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:01.625151 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.625132 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 18:58:01.625248 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.625198 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 18:58:01.625958 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.625940 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nchj8\"" Jul 10 18:58:01.626127 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.626103 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:01.626226 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.626168 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:01.626226 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.626186 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 18:58:01.627101 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.627080 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-251.ec2.internal"] Jul 10 18:58:01.627475 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.627189 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.629569 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.629243 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 18:58:01.629569 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.629368 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal"] Jul 10 18:58:01.630617 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.630600 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 18:58:01.630886 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.630868 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 18:58:01.630886 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.630881 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 18:58:01.630982 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.630904 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 18:58:01.630982 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.630875 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 18:58:01.631585 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.631571 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2cx7z\"" Jul 10 18:58:01.631637 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.631620 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 18:58:01.641952 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.641785 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:58:01.642053 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.642022 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w4dxp" Jul 10 18:58:01.649593 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.649477 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w4dxp" Jul 10 18:58:01.656642 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.656606 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 18:53:01 +0000 UTC" deadline="2028-01-20 13:55:54.745556679 +0000 UTC" Jul 10 18:58:01.656642 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.656640 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13410h57m53.088918728s" Jul 10 18:58:01.701264 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:01.701226 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9137c4307049750dc9b17b99b29ee7.slice/crio-742514b9616560fe87183b01ea603f98f44a3ebc11b4336bc87a02f27ff9c102 WatchSource:0}: Error finding container 742514b9616560fe87183b01ea603f98f44a3ebc11b4336bc87a02f27ff9c102: Status 404 returned error can't find the container with id 742514b9616560fe87183b01ea603f98f44a3ebc11b4336bc87a02f27ff9c102 Jul 10 18:58:01.704263 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.704237 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 18:58:01.706825 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.706808 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:58:01.711495 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711466 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-systemd-units\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.711576 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711504 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-ovnkube-config\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.711576 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711554 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90241756-3f53-4e94-9ec8-bafd35852833-tmp\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.711651 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711596 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-system-cni-dir\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.711651 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711631 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-multus-cni-dir\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.711729 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711650 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-socket-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.711729 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm8sl\" (UniqueName: \"kubernetes.io/projected/83909fc5-af6d-409b-bbbb-6299c8005fd9-kube-api-access-hm8sl\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.711729 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711695 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85503e38-dcb0-4845-9510-cb8847afef80-serviceca\") pod \"node-ca-hsg7h\" (UID: \"85503e38-dcb0-4845-9510-cb8847afef80\") " pod="openshift-image-registry/node-ca-hsg7h" Jul 10 18:58:01.711729 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711719 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-etc-openvswitch\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.711851 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711735 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vt9j\" (UniqueName: \"kubernetes.io/projected/fa65d760-c275-48f6-821c-75812000515d-kube-api-access-5vt9j\") pod \"iptables-alerter-t5fwr\" (UID: \"fa65d760-c275-48f6-821c-75812000515d\") " pod="openshift-network-operator/iptables-alerter-t5fwr" Jul 10 18:58:01.711851 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711750 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdtjr\" (UniqueName: \"kubernetes.io/projected/85503e38-dcb0-4845-9510-cb8847afef80-kube-api-access-sdtjr\") pod \"node-ca-hsg7h\" (UID: \"85503e38-dcb0-4845-9510-cb8847afef80\") " pod="openshift-image-registry/node-ca-hsg7h" Jul 10 18:58:01.711851 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711768 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3874646-e1df-44b0-9c8d-33ec78921823-tmp-dir\") pod \"node-resolver-jfrgv\" (UID: \"c3874646-e1df-44b0-9c8d-33ec78921823\") " pod="openshift-dns/node-resolver-jfrgv" Jul 10 18:58:01.711851 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711802 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-sysconfig\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.711851 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711827 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77d94732-b3cb-4630-8b2b-27e916f1e5ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.711851 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711848 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt9xs\" (UniqueName: \"kubernetes.io/projected/77d94732-b3cb-4630-8b2b-27e916f1e5ea-kube-api-access-dt9xs\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.712029 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711868 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-run-k8s-cni-cncf-io\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.712029 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711892 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2828a377-eaa1-4176-8eba-f01f984857d2-multus-daemon-config\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.712029 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711907 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-etc-kubernetes\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.712029 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711924 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-sys-fs\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.712029 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6093f54c-d2e1-4752-a781-fec00493f97f-kubelet-config\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:01.712029 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711977 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spzqc\" (UniqueName: \"kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc\") pod \"network-check-target-dsprs\" (UID: \"47b6ad13-974c-40f4-872a-473250c868f7\") " pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:01.712029 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.711993 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-slash\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.712029 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712009 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-node-log\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712039 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712065 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-os-release\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712126 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49lml\" (UniqueName: \"kubernetes.io/projected/2828a377-eaa1-4176-8eba-f01f984857d2-kube-api-access-49lml\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712143 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77d94732-b3cb-4630-8b2b-27e916f1e5ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712157 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-device-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712179 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-kubelet\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712219 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a-agent-certs\") pod \"konnectivity-agent-pz6wd\" (UID: \"9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a\") " pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90241756-3f53-4e94-9ec8-bafd35852833-etc-tuned\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712299 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712326 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-sys\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712347 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-ovnkube-script-lib\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.712380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712371 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-sysctl-d\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77d94732-b3cb-4630-8b2b-27e916f1e5ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712427 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712473 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6093f54c-d2e1-4752-a781-fec00493f97f-dbus\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-run-systemd\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712525 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-ovn-node-metrics-cert\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712541 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j9pd\" (UniqueName: \"kubernetes.io/projected/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-kube-api-access-8j9pd\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-var-lib-kubelet\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712578 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-system-cni-dir\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712608 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-env-overrides\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712644 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-systemd\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712674 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-os-release\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712699 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-run-netns\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712722 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-hostroot\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712744 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa65d760-c275-48f6-821c-75812000515d-host-slash\") pod \"iptables-alerter-t5fwr\" (UID: \"fa65d760-c275-48f6-821c-75812000515d\") " pod="openshift-network-operator/iptables-alerter-t5fwr" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712766 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85503e38-dcb0-4845-9510-cb8847afef80-host\") pod \"node-ca-hsg7h\" (UID: \"85503e38-dcb0-4845-9510-cb8847afef80\") " pod="openshift-image-registry/node-ca-hsg7h" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712790 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-cni-netd\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.712954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712815 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-run-netns\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712840 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-run-ovn\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-modprobe-d\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712890 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-sysctl-conf\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-multus-conf-dir\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712938 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-run-multus-certs\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712961 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-host\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.712985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2828a377-eaa1-4176-8eba-f01f984857d2-cni-binary-copy\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa65d760-c275-48f6-821c-75812000515d-iptables-alerter-script\") pod \"iptables-alerter-t5fwr\" (UID: \"fa65d760-c275-48f6-821c-75812000515d\") " pod="openshift-network-operator/iptables-alerter-t5fwr" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713034 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-registration-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713060 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713106 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-var-lib-openvswitch\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhvvm\" (UniqueName: \"kubernetes.io/projected/90241756-3f53-4e94-9ec8-bafd35852833-kube-api-access-zhvvm\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713183 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-cnibin\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713198 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3874646-e1df-44b0-9c8d-33ec78921823-hosts-file\") pod \"node-resolver-jfrgv\" (UID: \"c3874646-e1df-44b0-9c8d-33ec78921823\") " pod="openshift-dns/node-resolver-jfrgv" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713220 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8dzs\" (UniqueName: \"kubernetes.io/projected/c3874646-e1df-44b0-9c8d-33ec78921823-kube-api-access-x8dzs\") pod \"node-resolver-jfrgv\" (UID: \"c3874646-e1df-44b0-9c8d-33ec78921823\") " pod="openshift-dns/node-resolver-jfrgv" Jul 10 18:58:01.713773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713277 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-run-openvswitch\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713305 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-run-ovn-kubernetes\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713331 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-run\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-var-lib-cni-bin\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713381 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmkfk\" (UniqueName: \"kubernetes.io/projected/9668ee03-c888-4b72-96a5-f35850c46e12-kube-api-access-zmkfk\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713420 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-log-socket\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713464 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-cni-bin\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713498 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a-konnectivity-ca\") pod \"konnectivity-agent-pz6wd\" (UID: \"9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a\") " pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713524 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-lib-modules\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713660 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-var-lib-cni-multus\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713689 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713711 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-kubernetes\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713735 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-cnibin\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713758 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-multus-socket-dir-parent\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.714296 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.713783 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-var-lib-kubelet\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.716907 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.716871 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-251.ec2.internal" event={"ID":"ec9137c4307049750dc9b17b99b29ee7","Type":"ContainerStarted","Data":"742514b9616560fe87183b01ea603f98f44a3ebc11b4336bc87a02f27ff9c102"} Jul 10 18:58:01.814469 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814438 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2828a377-eaa1-4176-8eba-f01f984857d2-multus-daemon-config\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.814667 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814486 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-etc-kubernetes\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.814667 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814511 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-sys-fs\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.814667 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814536 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6093f54c-d2e1-4752-a781-fec00493f97f-kubelet-config\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:01.814667 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814559 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spzqc\" (UniqueName: \"kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc\") pod \"network-check-target-dsprs\" (UID: \"47b6ad13-974c-40f4-872a-473250c868f7\") " pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:01.814667 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814589 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-etc-kubernetes\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.814667 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814627 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-sys-fs\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.814667 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814636 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6093f54c-d2e1-4752-a781-fec00493f97f-kubelet-config\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:01.815019 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814673 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-slash\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815019 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814761 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-slash\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815019 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814833 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-node-log\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815154 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815092 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2828a377-eaa1-4176-8eba-f01f984857d2-multus-daemon-config\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.815213 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.814702 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-node-log\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815260 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815238 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815260 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815258 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-os-release\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.815374 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815274 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49lml\" (UniqueName: \"kubernetes.io/projected/2828a377-eaa1-4176-8eba-f01f984857d2-kube-api-access-49lml\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.815374 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815308 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77d94732-b3cb-4630-8b2b-27e916f1e5ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.815374 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815334 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-device-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.815521 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815389 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-os-release\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.815521 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815398 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-kubelet\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815521 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815425 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a-agent-certs\") pod \"konnectivity-agent-pz6wd\" (UID: \"9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a\") " pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:01.815521 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815444 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90241756-3f53-4e94-9ec8-bafd35852833-etc-tuned\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.815521 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815478 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-kubelet\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815521 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815480 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:01.815521 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-sys\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815543 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-ovnkube-script-lib\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.815578 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815600 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815615 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-sysctl-d\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.815644 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret podName:6093f54c-d2e1-4752-a781-fec00493f97f nodeName:}" failed. No retries permitted until 2026-07-10 18:58:02.315623292 +0000 UTC m=+2.067801009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret") pod "global-pull-secret-syncer-xxv9h" (UID: "6093f54c-d2e1-4752-a781-fec00493f97f") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815647 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-sys\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815675 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77d94732-b3cb-4630-8b2b-27e916f1e5ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815704 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815733 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6093f54c-d2e1-4752-a781-fec00493f97f-dbus\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815748 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-sysctl-d\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815759 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-run-systemd\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815810 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-run-systemd\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.815835 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815842 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-ovn-node-metrics-cert\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.815866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815842 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.815895 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs podName:9668ee03-c888-4b72-96a5-f35850c46e12 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:02.31587978 +0000 UTC m=+2.068057493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs") pod "network-metrics-daemon-4z4gc" (UID: "9668ee03-c888-4b72-96a5-f35850c46e12") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815969 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6093f54c-d2e1-4752-a781-fec00493f97f-dbus\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.815872 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j9pd\" (UniqueName: \"kubernetes.io/projected/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-kube-api-access-8j9pd\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816029 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-var-lib-kubelet\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816054 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-system-cni-dir\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816078 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-env-overrides\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816086 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77d94732-b3cb-4630-8b2b-27e916f1e5ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816102 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-systemd\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816110 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-var-lib-kubelet\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816152 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-systemd\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816160 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-device-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816181 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-ovnkube-script-lib\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816197 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-system-cni-dir\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816224 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-os-release\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816250 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-run-netns\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816272 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-hostroot\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.816611 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816297 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-os-release\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816316 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa65d760-c275-48f6-821c-75812000515d-host-slash\") pod \"iptables-alerter-t5fwr\" (UID: \"fa65d760-c275-48f6-821c-75812000515d\") " pod="openshift-network-operator/iptables-alerter-t5fwr" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816335 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77d94732-b3cb-4630-8b2b-27e916f1e5ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816340 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-run-netns\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816359 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-hostroot\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816341 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85503e38-dcb0-4845-9510-cb8847afef80-host\") pod \"node-ca-hsg7h\" (UID: \"85503e38-dcb0-4845-9510-cb8847afef80\") " pod="openshift-image-registry/node-ca-hsg7h" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816376 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85503e38-dcb0-4845-9510-cb8847afef80-host\") pod \"node-ca-hsg7h\" (UID: \"85503e38-dcb0-4845-9510-cb8847afef80\") " pod="openshift-image-registry/node-ca-hsg7h" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816367 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa65d760-c275-48f6-821c-75812000515d-host-slash\") pod \"iptables-alerter-t5fwr\" (UID: \"fa65d760-c275-48f6-821c-75812000515d\") " pod="openshift-network-operator/iptables-alerter-t5fwr" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816403 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-cni-netd\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816430 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-run-netns\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816456 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-run-ovn\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816469 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-cni-netd\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816480 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-modprobe-d\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816484 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-env-overrides\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816518 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-run-netns\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816546 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-run-ovn\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816620 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-sysctl-conf\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816655 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-multus-conf-dir\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.817210 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816662 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-modprobe-d\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816689 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-run-multus-certs\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816704 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-multus-conf-dir\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816714 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-host\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816739 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2828a377-eaa1-4176-8eba-f01f984857d2-cni-binary-copy\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816747 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-run-multus-certs\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816750 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-host\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816762 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa65d760-c275-48f6-821c-75812000515d-iptables-alerter-script\") pod \"iptables-alerter-t5fwr\" (UID: \"fa65d760-c275-48f6-821c-75812000515d\") " pod="openshift-network-operator/iptables-alerter-t5fwr" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816714 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-sysctl-conf\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.817737 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2828a377-eaa1-4176-8eba-f01f984857d2-cni-binary-copy\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.817826 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa65d760-c275-48f6-821c-75812000515d-iptables-alerter-script\") pod \"iptables-alerter-t5fwr\" (UID: \"fa65d760-c275-48f6-821c-75812000515d\") " pod="openshift-network-operator/iptables-alerter-t5fwr" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.816868 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-registration-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.817925 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.817955 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-var-lib-openvswitch\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.817997 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhvvm\" (UniqueName: \"kubernetes.io/projected/90241756-3f53-4e94-9ec8-bafd35852833-kube-api-access-zhvvm\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818031 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-cnibin\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.818071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818064 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3874646-e1df-44b0-9c8d-33ec78921823-hosts-file\") pod \"node-resolver-jfrgv\" (UID: \"c3874646-e1df-44b0-9c8d-33ec78921823\") " pod="openshift-dns/node-resolver-jfrgv" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818098 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8dzs\" (UniqueName: \"kubernetes.io/projected/c3874646-e1df-44b0-9c8d-33ec78921823-kube-api-access-x8dzs\") pod \"node-resolver-jfrgv\" (UID: \"c3874646-e1df-44b0-9c8d-33ec78921823\") " pod="openshift-dns/node-resolver-jfrgv" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818123 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-run-openvswitch\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818155 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-run-ovn-kubernetes\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818188 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-run\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818219 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-var-lib-cni-bin\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818252 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmkfk\" (UniqueName: \"kubernetes.io/projected/9668ee03-c888-4b72-96a5-f35850c46e12-kube-api-access-zmkfk\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818279 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-log-socket\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818326 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-cni-bin\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818358 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a-konnectivity-ca\") pod \"konnectivity-agent-pz6wd\" (UID: \"9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a\") " pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818389 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-lib-modules\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818422 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818450 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-var-lib-cni-multus\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818480 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818510 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-kubernetes\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818541 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-cnibin\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818572 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-multus-socket-dir-parent\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.818964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818598 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-var-lib-kubelet\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818629 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-systemd-units\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818659 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-ovnkube-config\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818689 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90241756-3f53-4e94-9ec8-bafd35852833-tmp\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818723 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-system-cni-dir\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818762 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-multus-cni-dir\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818792 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-socket-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818893 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm8sl\" (UniqueName: \"kubernetes.io/projected/83909fc5-af6d-409b-bbbb-6299c8005fd9-kube-api-access-hm8sl\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818926 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85503e38-dcb0-4845-9510-cb8847afef80-serviceca\") pod \"node-ca-hsg7h\" (UID: \"85503e38-dcb0-4845-9510-cb8847afef80\") " pod="openshift-image-registry/node-ca-hsg7h" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818957 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-etc-openvswitch\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.818989 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vt9j\" (UniqueName: \"kubernetes.io/projected/fa65d760-c275-48f6-821c-75812000515d-kube-api-access-5vt9j\") pod \"iptables-alerter-t5fwr\" (UID: \"fa65d760-c275-48f6-821c-75812000515d\") " pod="openshift-network-operator/iptables-alerter-t5fwr" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819015 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdtjr\" (UniqueName: \"kubernetes.io/projected/85503e38-dcb0-4845-9510-cb8847afef80-kube-api-access-sdtjr\") pod \"node-ca-hsg7h\" (UID: \"85503e38-dcb0-4845-9510-cb8847afef80\") " pod="openshift-image-registry/node-ca-hsg7h" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819046 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3874646-e1df-44b0-9c8d-33ec78921823-tmp-dir\") pod \"node-resolver-jfrgv\" (UID: \"c3874646-e1df-44b0-9c8d-33ec78921823\") " pod="openshift-dns/node-resolver-jfrgv" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819139 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-lib-modules\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-sysconfig\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819192 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77d94732-b3cb-4630-8b2b-27e916f1e5ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819225 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt9xs\" (UniqueName: \"kubernetes.io/projected/77d94732-b3cb-4630-8b2b-27e916f1e5ea-kube-api-access-dt9xs\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.819810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819253 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-run-k8s-cni-cncf-io\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819358 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-sysconfig\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819393 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-run-k8s-cni-cncf-io\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819490 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819501 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-system-cni-dir\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819545 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-var-lib-openvswitch\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819573 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-multus-cni-dir\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819692 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-socket-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819752 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-cnibin\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819762 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-var-lib-cni-multus\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819824 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-ovn-node-metrics-cert\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819831 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-run-openvswitch\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819852 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819920 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-etc-kubernetes\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.819973 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-cnibin\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820023 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90241756-3f53-4e94-9ec8-bafd35852833-run\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820057 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90241756-3f53-4e94-9ec8-bafd35852833-etc-tuned\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820074 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-etc-openvswitch\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.820696 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820149 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-log-socket\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820214 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-var-lib-kubelet\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820214 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-multus-socket-dir-parent\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820260 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-cni-bin\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820329 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-systemd-units\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820334 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85503e38-dcb0-4845-9510-cb8847afef80-serviceca\") pod \"node-ca-hsg7h\" (UID: \"85503e38-dcb0-4845-9510-cb8847afef80\") " pod="openshift-image-registry/node-ca-hsg7h" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820463 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3874646-e1df-44b0-9c8d-33ec78921823-tmp-dir\") pod \"node-resolver-jfrgv\" (UID: \"c3874646-e1df-44b0-9c8d-33ec78921823\") " pod="openshift-dns/node-resolver-jfrgv" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820540 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-host-run-ovn-kubernetes\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820598 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77d94732-b3cb-4630-8b2b-27e916f1e5ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820819 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a-agent-certs\") pod \"konnectivity-agent-pz6wd\" (UID: \"9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a\") " pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.820845 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77d94732-b3cb-4630-8b2b-27e916f1e5ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.821025 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2828a377-eaa1-4176-8eba-f01f984857d2-host-var-lib-cni-bin\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.821032 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83909fc5-af6d-409b-bbbb-6299c8005fd9-registration-dir\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.821164 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3874646-e1df-44b0-9c8d-33ec78921823-hosts-file\") pod \"node-resolver-jfrgv\" (UID: \"c3874646-e1df-44b0-9c8d-33ec78921823\") " pod="openshift-dns/node-resolver-jfrgv" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.821288 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-ovnkube-config\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.821653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.821576 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a-konnectivity-ca\") pod \"konnectivity-agent-pz6wd\" (UID: \"9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a\") " pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:01.822749 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.822715 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90241756-3f53-4e94-9ec8-bafd35852833-tmp\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.827088 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.827070 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:58:01.827193 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.827091 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:58:01.827193 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.827105 2555 projected.go:196] Error preparing data for projected volume kube-api-access-spzqc for pod openshift-network-diagnostics/network-check-target-dsprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:01.827193 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:01.827171 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc podName:47b6ad13-974c-40f4-872a-473250c868f7 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:02.327154838 +0000 UTC m=+2.079332540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-spzqc" (UniqueName: "kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc") pod "network-check-target-dsprs" (UID: "47b6ad13-974c-40f4-872a-473250c868f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:01.833831 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.833802 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdtjr\" (UniqueName: \"kubernetes.io/projected/85503e38-dcb0-4845-9510-cb8847afef80-kube-api-access-sdtjr\") pod \"node-ca-hsg7h\" (UID: \"85503e38-dcb0-4845-9510-cb8847afef80\") " pod="openshift-image-registry/node-ca-hsg7h" Jul 10 18:58:01.833929 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.833892 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vt9j\" (UniqueName: \"kubernetes.io/projected/fa65d760-c275-48f6-821c-75812000515d-kube-api-access-5vt9j\") pod \"iptables-alerter-t5fwr\" (UID: \"fa65d760-c275-48f6-821c-75812000515d\") " pod="openshift-network-operator/iptables-alerter-t5fwr" Jul 10 18:58:01.834616 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.834591 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49lml\" (UniqueName: \"kubernetes.io/projected/2828a377-eaa1-4176-8eba-f01f984857d2-kube-api-access-49lml\") pod \"multus-gkj7m\" (UID: \"2828a377-eaa1-4176-8eba-f01f984857d2\") " pod="openshift-multus/multus-gkj7m" Jul 10 18:58:01.834717 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.834693 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmkfk\" (UniqueName: \"kubernetes.io/projected/9668ee03-c888-4b72-96a5-f35850c46e12-kube-api-access-zmkfk\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:01.834814 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.834781 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j9pd\" (UniqueName: \"kubernetes.io/projected/1cac9ee7-9988-4a07-9561-af6ea5ef1f3f-kube-api-access-8j9pd\") pod \"ovnkube-node-29w9l\" (UID: \"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:01.835010 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.834964 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt9xs\" (UniqueName: \"kubernetes.io/projected/77d94732-b3cb-4630-8b2b-27e916f1e5ea-kube-api-access-dt9xs\") pod \"multus-additional-cni-plugins-plnr2\" (UID: \"77d94732-b3cb-4630-8b2b-27e916f1e5ea\") " pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.835072 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.835057 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8dzs\" (UniqueName: \"kubernetes.io/projected/c3874646-e1df-44b0-9c8d-33ec78921823-kube-api-access-x8dzs\") pod \"node-resolver-jfrgv\" (UID: \"c3874646-e1df-44b0-9c8d-33ec78921823\") " pod="openshift-dns/node-resolver-jfrgv" Jul 10 18:58:01.835836 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.835821 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhvvm\" (UniqueName: \"kubernetes.io/projected/90241756-3f53-4e94-9ec8-bafd35852833-kube-api-access-zhvvm\") pod \"tuned-zhj4g\" (UID: \"90241756-3f53-4e94-9ec8-bafd35852833\") " pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.836061 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.836045 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm8sl\" (UniqueName: \"kubernetes.io/projected/83909fc5-af6d-409b-bbbb-6299c8005fd9-kube-api-access-hm8sl\") pod \"aws-ebs-csi-driver-node-dgq6s\" (UID: \"83909fc5-af6d-409b-bbbb-6299c8005fd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:01.941980 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.941950 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:01.946455 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.946426 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" Jul 10 18:58:01.951859 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:01.951835 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2b7dba_e4f5_4c8d_9dc1_3d5871c3ba3a.slice/crio-fb7f4ff0c2840d5806e364baa206cbec187d1b04f5e83da186e0a2abc7c88e00 WatchSource:0}: Error finding container fb7f4ff0c2840d5806e364baa206cbec187d1b04f5e83da186e0a2abc7c88e00: Status 404 returned error can't find the container with id fb7f4ff0c2840d5806e364baa206cbec187d1b04f5e83da186e0a2abc7c88e00 Jul 10 18:58:01.954381 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:01.954359 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90241756_3f53_4e94_9ec8_bafd35852833.slice/crio-f9abf78a67ee08c93043ae098ec7a19dcaf75dfc7dfa112c0ff4a681d3f44703 WatchSource:0}: Error finding container f9abf78a67ee08c93043ae098ec7a19dcaf75dfc7dfa112c0ff4a681d3f44703: Status 404 returned error can't find the container with id f9abf78a67ee08c93043ae098ec7a19dcaf75dfc7dfa112c0ff4a681d3f44703 Jul 10 18:58:01.961531 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.961513 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:58:01.970043 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.970024 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jfrgv" Jul 10 18:58:01.977010 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:01.976987 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3874646_e1df_44b0_9c8d_33ec78921823.slice/crio-80d0388705f59c4c0fdbf1c985a4fe4fba8b8dacad5e628d935cebcf9bad0193 WatchSource:0}: Error finding container 80d0388705f59c4c0fdbf1c985a4fe4fba8b8dacad5e628d935cebcf9bad0193: Status 404 returned error can't find the container with id 80d0388705f59c4c0fdbf1c985a4fe4fba8b8dacad5e628d935cebcf9bad0193 Jul 10 18:58:01.986922 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:01.986907 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-plnr2" Jul 10 18:58:01.994190 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:01.994169 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d94732_b3cb_4630_8b2b_27e916f1e5ea.slice/crio-714bd97584b31d7348b451f67ca341205dfbe1e13e58df21ff62f7518fc21619 WatchSource:0}: Error finding container 714bd97584b31d7348b451f67ca341205dfbe1e13e58df21ff62f7518fc21619: Status 404 returned error can't find the container with id 714bd97584b31d7348b451f67ca341205dfbe1e13e58df21ff62f7518fc21619 Jul 10 18:58:02.005777 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.005761 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gkj7m" Jul 10 18:58:02.012434 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.012411 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t5fwr" Jul 10 18:58:02.012731 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:02.012709 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2828a377_eaa1_4176_8eba_f01f984857d2.slice/crio-e499a843064a2835252a57a8defd78988b91758b80bffca6a359ce0aeac27617 WatchSource:0}: Error finding container e499a843064a2835252a57a8defd78988b91758b80bffca6a359ce0aeac27617: Status 404 returned error can't find the container with id e499a843064a2835252a57a8defd78988b91758b80bffca6a359ce0aeac27617 Jul 10 18:58:02.019586 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.019565 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" Jul 10 18:58:02.021106 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:02.021087 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa65d760_c275_48f6_821c_75812000515d.slice/crio-67b1a380ef659f08f731da364ef85f784f7da1831eb58646bd45eb03c21f2740 WatchSource:0}: Error finding container 67b1a380ef659f08f731da364ef85f784f7da1831eb58646bd45eb03c21f2740: Status 404 returned error can't find the container with id 67b1a380ef659f08f731da364ef85f784f7da1831eb58646bd45eb03c21f2740 Jul 10 18:58:02.025182 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.025165 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hsg7h" Jul 10 18:58:02.027288 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:02.027267 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83909fc5_af6d_409b_bbbb_6299c8005fd9.slice/crio-d50e028abb0fe5338e288f699636e806c9fce4d886a05dde1f5ef00db0ed94ce WatchSource:0}: Error finding container d50e028abb0fe5338e288f699636e806c9fce4d886a05dde1f5ef00db0ed94ce: Status 404 returned error can't find the container with id d50e028abb0fe5338e288f699636e806c9fce4d886a05dde1f5ef00db0ed94ce Jul 10 18:58:02.029464 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.029447 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:02.032830 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:02.032783 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85503e38_dcb0_4845_9510_cb8847afef80.slice/crio-ed7f30a437b80aeeaa488b1da5890cd505318c870b7981def7b14cd309aafa34 WatchSource:0}: Error finding container ed7f30a437b80aeeaa488b1da5890cd505318c870b7981def7b14cd309aafa34: Status 404 returned error can't find the container with id ed7f30a437b80aeeaa488b1da5890cd505318c870b7981def7b14cd309aafa34 Jul 10 18:58:02.037233 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:02.037212 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cac9ee7_9988_4a07_9561_af6ea5ef1f3f.slice/crio-95cde8f2bcf641d79e52ddebd5e0037fa86076a8ba4b4ad310fb5db5ee1e2465 WatchSource:0}: Error finding container 95cde8f2bcf641d79e52ddebd5e0037fa86076a8ba4b4ad310fb5db5ee1e2465: Status 404 returned error can't find the container with id 95cde8f2bcf641d79e52ddebd5e0037fa86076a8ba4b4ad310fb5db5ee1e2465 Jul 10 18:58:02.323046 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.323005 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:02.323209 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.323055 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:02.323209 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:02.323171 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:02.323352 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:02.323221 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:02.323352 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:02.323241 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret podName:6093f54c-d2e1-4752-a781-fec00493f97f nodeName:}" failed. No retries permitted until 2026-07-10 18:58:03.323220167 +0000 UTC m=+3.075398093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret") pod "global-pull-secret-syncer-xxv9h" (UID: "6093f54c-d2e1-4752-a781-fec00493f97f") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:02.323352 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:02.323293 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs podName:9668ee03-c888-4b72-96a5-f35850c46e12 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:03.323281473 +0000 UTC m=+3.075459176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs") pod "network-metrics-daemon-4z4gc" (UID: "9668ee03-c888-4b72-96a5-f35850c46e12") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:02.423997 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.423910 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spzqc\" (UniqueName: \"kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc\") pod \"network-check-target-dsprs\" (UID: \"47b6ad13-974c-40f4-872a-473250c868f7\") " pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:02.424282 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:02.424237 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:58:02.424381 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:02.424271 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:58:02.424381 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:02.424304 2555 projected.go:196] Error preparing data for projected volume kube-api-access-spzqc for pod openshift-network-diagnostics/network-check-target-dsprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:02.424381 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:02.424371 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc podName:47b6ad13-974c-40f4-872a-473250c868f7 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:03.424351336 +0000 UTC m=+3.176529035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-spzqc" (UniqueName: "kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc") pod "network-check-target-dsprs" (UID: "47b6ad13-974c-40f4-872a-473250c868f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:02.651907 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.651866 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:53:02 +0000 UTC" deadline="2027-12-26 02:33:18.547141399 +0000 UTC" Jul 10 18:58:02.651907 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.651903 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12799h35m15.895242772s" Jul 10 18:58:02.732221 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.732132 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" event={"ID":"2cd3e1ad6699b6d3543e0c80246f16cd","Type":"ContainerStarted","Data":"f2ce2957fba4a03a1180243b2fc33cbf37355b820af8d3b2ab26e48dff581b26"} Jul 10 18:58:02.743646 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.743611 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hsg7h" event={"ID":"85503e38-dcb0-4845-9510-cb8847afef80","Type":"ContainerStarted","Data":"ed7f30a437b80aeeaa488b1da5890cd505318c870b7981def7b14cd309aafa34"} Jul 10 18:58:02.745500 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.745465 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" event={"ID":"83909fc5-af6d-409b-bbbb-6299c8005fd9","Type":"ContainerStarted","Data":"d50e028abb0fe5338e288f699636e806c9fce4d886a05dde1f5ef00db0ed94ce"} Jul 10 18:58:02.758077 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.758050 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t5fwr" event={"ID":"fa65d760-c275-48f6-821c-75812000515d","Type":"ContainerStarted","Data":"67b1a380ef659f08f731da364ef85f784f7da1831eb58646bd45eb03c21f2740"} Jul 10 18:58:02.779007 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.778937 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gkj7m" event={"ID":"2828a377-eaa1-4176-8eba-f01f984857d2","Type":"ContainerStarted","Data":"e499a843064a2835252a57a8defd78988b91758b80bffca6a359ce0aeac27617"} Jul 10 18:58:02.792872 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.792747 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jfrgv" event={"ID":"c3874646-e1df-44b0-9c8d-33ec78921823","Type":"ContainerStarted","Data":"80d0388705f59c4c0fdbf1c985a4fe4fba8b8dacad5e628d935cebcf9bad0193"} Jul 10 18:58:02.796796 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.796688 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" event={"ID":"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f","Type":"ContainerStarted","Data":"95cde8f2bcf641d79e52ddebd5e0037fa86076a8ba4b4ad310fb5db5ee1e2465"} Jul 10 18:58:02.807755 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.807696 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plnr2" event={"ID":"77d94732-b3cb-4630-8b2b-27e916f1e5ea","Type":"ContainerStarted","Data":"714bd97584b31d7348b451f67ca341205dfbe1e13e58df21ff62f7518fc21619"} Jul 10 18:58:02.819025 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.819000 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" event={"ID":"90241756-3f53-4e94-9ec8-bafd35852833","Type":"ContainerStarted","Data":"f9abf78a67ee08c93043ae098ec7a19dcaf75dfc7dfa112c0ff4a681d3f44703"} Jul 10 18:58:02.833388 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:02.833290 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pz6wd" event={"ID":"9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a","Type":"ContainerStarted","Data":"fb7f4ff0c2840d5806e364baa206cbec187d1b04f5e83da186e0a2abc7c88e00"} Jul 10 18:58:03.053031 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:03.052951 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:58:03.330237 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:03.329454 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:03.330237 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:03.329508 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:03.330237 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:03.329628 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:03.330237 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:03.329692 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs podName:9668ee03-c888-4b72-96a5-f35850c46e12 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:05.329672836 +0000 UTC m=+5.081850542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs") pod "network-metrics-daemon-4z4gc" (UID: "9668ee03-c888-4b72-96a5-f35850c46e12") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:03.330237 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:03.330103 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:03.330237 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:03.330153 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret podName:6093f54c-d2e1-4752-a781-fec00493f97f nodeName:}" failed. No retries permitted until 2026-07-10 18:58:05.330138189 +0000 UTC m=+5.082315902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret") pod "global-pull-secret-syncer-xxv9h" (UID: "6093f54c-d2e1-4752-a781-fec00493f97f") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:03.429853 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:03.429818 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spzqc\" (UniqueName: \"kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc\") pod \"network-check-target-dsprs\" (UID: \"47b6ad13-974c-40f4-872a-473250c868f7\") " pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:03.430051 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:03.429989 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:58:03.430051 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:03.430008 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:58:03.430051 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:03.430019 2555 projected.go:196] Error preparing data for projected volume kube-api-access-spzqc for pod openshift-network-diagnostics/network-check-target-dsprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:03.430212 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:03.430072 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc podName:47b6ad13-974c-40f4-872a-473250c868f7 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:05.430055229 +0000 UTC m=+5.182232934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-spzqc" (UniqueName: "kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc") pod "network-check-target-dsprs" (UID: "47b6ad13-974c-40f4-872a-473250c868f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:03.605536 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:03.605457 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:58:03.652558 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:03.652465 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:53:02 +0000 UTC" deadline="2028-04-16 14:22:42.880580376 +0000 UTC" Jul 10 18:58:03.652558 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:03.652521 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15499h24m39.228063241s" Jul 10 18:58:03.714458 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:03.714427 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:03.714618 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:03.714564 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:03.714995 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:03.714969 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:03.715113 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:03.715074 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:03.715178 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:03.715143 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:03.715249 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:03.715229 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:05.347809 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:05.347772 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:05.348245 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:05.347822 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:05.348245 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:05.347956 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:05.348245 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:05.348015 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs podName:9668ee03-c888-4b72-96a5-f35850c46e12 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:09.347996827 +0000 UTC m=+9.100174532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs") pod "network-metrics-daemon-4z4gc" (UID: "9668ee03-c888-4b72-96a5-f35850c46e12") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:05.348466 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:05.348438 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:05.348522 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:05.348495 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret podName:6093f54c-d2e1-4752-a781-fec00493f97f nodeName:}" failed. No retries permitted until 2026-07-10 18:58:09.34847729 +0000 UTC m=+9.100654991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret") pod "global-pull-secret-syncer-xxv9h" (UID: "6093f54c-d2e1-4752-a781-fec00493f97f") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:05.449071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:05.448985 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spzqc\" (UniqueName: \"kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc\") pod \"network-check-target-dsprs\" (UID: \"47b6ad13-974c-40f4-872a-473250c868f7\") " pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:05.449758 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:05.449213 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:58:05.449758 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:05.449239 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:58:05.449758 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:05.449253 2555 projected.go:196] Error preparing data for projected volume kube-api-access-spzqc for pod openshift-network-diagnostics/network-check-target-dsprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:05.449758 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:05.449324 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc podName:47b6ad13-974c-40f4-872a-473250c868f7 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:09.44930522 +0000 UTC m=+9.201482919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-spzqc" (UniqueName: "kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc") pod "network-check-target-dsprs" (UID: "47b6ad13-974c-40f4-872a-473250c868f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:05.715839 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:05.714817 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:05.715839 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:05.715014 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:05.715839 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:05.715482 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:05.715839 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:05.715590 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:05.715839 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:05.715642 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:05.715839 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:05.715741 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:07.715345 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:07.715304 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:07.715812 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:07.715432 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:07.715812 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:07.715596 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:07.715812 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:07.715612 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:07.715812 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:07.715723 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:07.716010 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:07.715835 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:09.385841 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:09.385801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:09.386282 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:09.385849 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:09.386282 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:09.385982 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:09.386282 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:09.386042 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs podName:9668ee03-c888-4b72-96a5-f35850c46e12 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:17.386024182 +0000 UTC m=+17.138201883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs") pod "network-metrics-daemon-4z4gc" (UID: "9668ee03-c888-4b72-96a5-f35850c46e12") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:09.386474 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:09.386452 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:09.386535 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:09.386519 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret podName:6093f54c-d2e1-4752-a781-fec00493f97f nodeName:}" failed. No retries permitted until 2026-07-10 18:58:17.386501743 +0000 UTC m=+17.138679444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret") pod "global-pull-secret-syncer-xxv9h" (UID: "6093f54c-d2e1-4752-a781-fec00493f97f") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:09.487227 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:09.487133 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spzqc\" (UniqueName: \"kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc\") pod \"network-check-target-dsprs\" (UID: \"47b6ad13-974c-40f4-872a-473250c868f7\") " pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:09.487401 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:09.487337 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:58:09.487401 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:09.487362 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:58:09.487401 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:09.487375 2555 projected.go:196] Error preparing data for projected volume kube-api-access-spzqc for pod openshift-network-diagnostics/network-check-target-dsprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:09.487551 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:09.487425 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc podName:47b6ad13-974c-40f4-872a-473250c868f7 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:17.487411291 +0000 UTC m=+17.239588988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-spzqc" (UniqueName: "kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc") pod "network-check-target-dsprs" (UID: "47b6ad13-974c-40f4-872a-473250c868f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:09.714389 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:09.714305 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:09.714532 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:09.714305 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:09.714532 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:09.714425 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:09.714532 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:09.714305 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:09.714532 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:09.714504 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:09.714716 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:09.714564 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:11.715092 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:11.714457 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:11.715092 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:11.714502 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:11.715092 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:11.714460 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:11.715092 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:11.714584 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:11.715092 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:11.714661 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:11.715092 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:11.714753 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:13.714558 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:13.714533 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:13.714943 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:13.714564 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:13.714943 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:13.714631 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:13.714943 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:13.714663 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:13.714943 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:13.714733 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:13.714943 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:13.714777 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:15.714318 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:15.714281 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:15.714318 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:15.714320 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:15.714792 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:15.714277 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:15.714792 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:15.714399 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:15.714792 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:15.714494 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:15.714792 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:15.714583 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:17.448530 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:17.448495 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:17.448530 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:17.448531 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:17.449081 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:17.448640 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:17.449081 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:17.448694 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs podName:9668ee03-c888-4b72-96a5-f35850c46e12 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:33.448680339 +0000 UTC m=+33.200858037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs") pod "network-metrics-daemon-4z4gc" (UID: "9668ee03-c888-4b72-96a5-f35850c46e12") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:17.449081 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:17.448640 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:17.449081 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:17.448767 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret podName:6093f54c-d2e1-4752-a781-fec00493f97f nodeName:}" failed. No retries permitted until 2026-07-10 18:58:33.448753109 +0000 UTC m=+33.200930820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret") pod "global-pull-secret-syncer-xxv9h" (UID: "6093f54c-d2e1-4752-a781-fec00493f97f") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:17.549358 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:17.549325 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spzqc\" (UniqueName: \"kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc\") pod \"network-check-target-dsprs\" (UID: \"47b6ad13-974c-40f4-872a-473250c868f7\") " pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:17.549517 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:17.549454 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:58:17.549517 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:17.549469 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:58:17.549517 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:17.549481 2555 projected.go:196] Error preparing data for projected volume kube-api-access-spzqc for pod openshift-network-diagnostics/network-check-target-dsprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:17.549628 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:17.549533 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc podName:47b6ad13-974c-40f4-872a-473250c868f7 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:33.549517608 +0000 UTC m=+33.301695309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-spzqc" (UniqueName: "kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc") pod "network-check-target-dsprs" (UID: "47b6ad13-974c-40f4-872a-473250c868f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:17.714810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:17.714731 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:17.714956 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:17.714731 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:17.714956 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:17.714864 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:17.714956 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:17.714731 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:17.715117 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:17.714953 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:17.715117 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:17.715012 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:19.715344 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:19.715310 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:19.715766 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:19.715359 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:19.715766 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:19.715319 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:19.715766 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:19.715430 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:19.715766 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:19.715519 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:19.715766 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:19.715617 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:21.715310 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:21.715281 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:21.715310 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:21.715298 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:21.715659 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:21.715298 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:21.715659 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:21.715369 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:21.715659 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:21.715463 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:21.715659 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:21.715532 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:22.877946 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.877783 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gkj7m" event={"ID":"2828a377-eaa1-4176-8eba-f01f984857d2","Type":"ContainerStarted","Data":"f80b971dceb4ca7c54ba88819040820c9dcedaabef3dd345cc1c60f4671d4aac"} Jul 10 18:58:22.880658 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.880637 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 18:58:22.880937 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.880915 2555 generic.go:356] "Generic (PLEG): container finished" podID="1cac9ee7-9988-4a07-9561-af6ea5ef1f3f" containerID="72701884df89aa6f10525afea49736460736986c33e3cd5ee8bbdd0ddd185800" exitCode=1 Jul 10 18:58:22.881010 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.880978 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" event={"ID":"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f","Type":"ContainerStarted","Data":"1a0760a18803e9b33f88e645a850fc9ef91a460f20eb24b3c0ac1ee5ae8501ff"} Jul 10 18:58:22.881064 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.881038 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" event={"ID":"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f","Type":"ContainerStarted","Data":"186da1abc2328a29f7b2bed9c91fafcef309e6e71f0e5ece7bc6a8eb3bbed04b"} Jul 10 18:58:22.881148 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.881072 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" event={"ID":"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f","Type":"ContainerStarted","Data":"9a43193aaa1392f09b91848ce81fe023c9c29b8c3b68b7c8da462970acc4b4e7"} Jul 10 18:58:22.881148 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.881100 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" event={"ID":"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f","Type":"ContainerStarted","Data":"41d92f4b46adbc893539c2373d95960996bc83edb0a69fc58038e60ed845a0b6"} Jul 10 18:58:22.881148 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.881128 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" event={"ID":"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f","Type":"ContainerDied","Data":"72701884df89aa6f10525afea49736460736986c33e3cd5ee8bbdd0ddd185800"} Jul 10 18:58:22.881325 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.881170 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" event={"ID":"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f","Type":"ContainerStarted","Data":"04916b12b5a37cfa21e3f5fe6cece5ccca050913d5f0754597b195e91a7ba584"} Jul 10 18:58:22.882386 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.882357 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" event={"ID":"90241756-3f53-4e94-9ec8-bafd35852833","Type":"ContainerStarted","Data":"dc54d069e8a7ea14d499f89c0e18c42e9c42ea9a835c658482bc4966dc05a5e0"} Jul 10 18:58:22.884160 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.884136 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-251.ec2.internal" event={"ID":"ec9137c4307049750dc9b17b99b29ee7","Type":"ContainerStarted","Data":"fd3579bbecaf95c9ba0f5786722eda4e3e7a005ba54c1e4fe537f5c54b134539"} Jul 10 18:58:22.897817 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.897778 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gkj7m" podStartSLOduration=1.871444758 podStartE2EDuration="21.897766693s" totalImagesPullingTime="20.026321935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:22.897664413 +0000 UTC m=+22.649842134" watchObservedRunningTime="2026-07-10 18:58:22.897766693 +0000 UTC m=+22.649944413" Jul 10 18:58:22.914408 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.914375 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zhj4g" podStartSLOduration=2.072278878 podStartE2EDuration="21.914362307s" totalImagesPullingTime="19.842083429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:22.914323637 +0000 UTC m=+22.666501356" watchObservedRunningTime="2026-07-10 18:58:22.914362307 +0000 UTC m=+22.666540024" Jul 10 18:58:22.928003 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:22.927972 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-251.ec2.internal" podStartSLOduration=20.927951896 podStartE2EDuration="20.927951896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:22.927715637 +0000 UTC m=+22.679893355" watchObservedRunningTime="2026-07-10 18:58:22.927951896 +0000 UTC m=+22.680129614" Jul 10 18:58:23.714607 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.714432 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:23.714752 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.714430 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:23.714752 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:23.714688 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:23.714752 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:23.714739 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:23.714752 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.714432 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:23.714876 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:23.714797 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:23.887033 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.886997 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jfrgv" event={"ID":"c3874646-e1df-44b0-9c8d-33ec78921823","Type":"ContainerStarted","Data":"c95a7b2368563710bd0a43964b956bc53cdfca038ba7411d6e86c34a1d4b05f0"} Jul 10 18:58:23.888403 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.888380 2555 generic.go:356] "Generic (PLEG): container finished" podID="77d94732-b3cb-4630-8b2b-27e916f1e5ea" containerID="6bbd2576062f35b196e2501175b5f17553e845caef9311fda4dbd92c3b9235de" exitCode=0 Jul 10 18:58:23.888525 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.888459 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plnr2" event={"ID":"77d94732-b3cb-4630-8b2b-27e916f1e5ea","Type":"ContainerDied","Data":"6bbd2576062f35b196e2501175b5f17553e845caef9311fda4dbd92c3b9235de"} Jul 10 18:58:23.889848 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.889777 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pz6wd" event={"ID":"9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a","Type":"ContainerStarted","Data":"846019fae8f3ba6c33d5554e592566d0035b4e631207e2c4ea4a69724790f24b"} Jul 10 18:58:23.891207 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.891174 2555 generic.go:356] "Generic (PLEG): container finished" podID="2cd3e1ad6699b6d3543e0c80246f16cd" containerID="31d88d38e31328da7a6b55f257943329884bc9f96a9579afc6cef995568bd7f8" exitCode=0 Jul 10 18:58:23.891318 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.891269 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" event={"ID":"2cd3e1ad6699b6d3543e0c80246f16cd","Type":"ContainerDied","Data":"31d88d38e31328da7a6b55f257943329884bc9f96a9579afc6cef995568bd7f8"} Jul 10 18:58:23.892618 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.892600 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hsg7h" event={"ID":"85503e38-dcb0-4845-9510-cb8847afef80","Type":"ContainerStarted","Data":"9749068f1fbd15703d60619bb4b6f9ecb2ba353c0a1403fa92cc9117db1e1bd7"} Jul 10 18:58:23.893905 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.893882 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" event={"ID":"83909fc5-af6d-409b-bbbb-6299c8005fd9","Type":"ContainerStarted","Data":"e5e7e0588e4ea24d694c4f75c327f86f6ca787e751cb0cffb88c5eb64801b858"} Jul 10 18:58:23.895182 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.895159 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t5fwr" event={"ID":"fa65d760-c275-48f6-821c-75812000515d","Type":"ContainerStarted","Data":"e6df6ba0972d2fae4b4dd81df55e2b975fe26a8350ff8706a50bd7e267bee0f7"} Jul 10 18:58:23.915154 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.915102 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jfrgv" podStartSLOduration=3.096335845 podStartE2EDuration="22.915086278s" totalImagesPullingTime="19.818750433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:23.915086213 +0000 UTC m=+23.667263934" watchObservedRunningTime="2026-07-10 18:58:23.915086278 +0000 UTC m=+23.667263999" Jul 10 18:58:23.933029 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.932993 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pz6wd" podStartSLOduration=3.141284366 podStartE2EDuration="22.93298012s" totalImagesPullingTime="19.791695754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:23.932599389 +0000 UTC m=+23.684777108" watchObservedRunningTime="2026-07-10 18:58:23.93298012 +0000 UTC m=+23.685157839" Jul 10 18:58:23.975950 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:23.975918 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hsg7h" podStartSLOduration=3.214432744 podStartE2EDuration="22.975903898s" totalImagesPullingTime="19.761471154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:23.975823818 +0000 UTC m=+23.728001534" watchObservedRunningTime="2026-07-10 18:58:23.975903898 +0000 UTC m=+23.728081660" Jul 10 18:58:24.009936 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:24.009900 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t5fwr" podStartSLOduration=3.2513679460000002 podStartE2EDuration="23.009887507s" totalImagesPullingTime="19.758519561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:24.009772246 +0000 UTC m=+23.761949965" watchObservedRunningTime="2026-07-10 18:58:24.009887507 +0000 UTC m=+23.762065238" Jul 10 18:58:24.162626 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:24.162605 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 18:58:24.673470 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:24.673347 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T18:58:24.162621587Z","UUID":"6471a94a-4d40-42ca-ae07-f0ce1dce7a25","Handler":null,"Name":"","Endpoint":""} Jul 10 18:58:24.674911 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:24.674881 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 18:58:24.675032 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:24.674922 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 18:58:24.898636 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:24.898610 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" event={"ID":"83909fc5-af6d-409b-bbbb-6299c8005fd9","Type":"ContainerStarted","Data":"335f415fd1895d5501a9c143837562cb0c5c769725593c98efdaacdbc4d4980e"} Jul 10 18:58:24.900083 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:24.900056 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" event={"ID":"2cd3e1ad6699b6d3543e0c80246f16cd","Type":"ContainerStarted","Data":"e4fda33198690c1a5f7004ef006441dcd9b113478a64b0d27b6f6750d2094a78"} Jul 10 18:58:24.916549 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:24.916465 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-251.ec2.internal" podStartSLOduration=22.916447337 podStartE2EDuration="22.916447337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:24.916055328 +0000 UTC m=+24.668233047" watchObservedRunningTime="2026-07-10 18:58:24.916447337 +0000 UTC m=+24.668625057" Jul 10 18:58:25.125541 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:25.125471 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:25.125979 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:25.125959 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:25.271693 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:25.271667 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:25.272163 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:25.272141 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pz6wd" Jul 10 18:58:25.714989 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:25.714919 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:25.715213 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:25.714919 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:25.715213 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:25.715014 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:25.715213 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:25.715118 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:25.715213 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:25.714920 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:25.715416 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:25.715255 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:25.905121 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:25.905085 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" event={"ID":"83909fc5-af6d-409b-bbbb-6299c8005fd9","Type":"ContainerStarted","Data":"9d9c812accf0877705e4280ab124e408e9386add355b97bfce46244f5fb67ccb"} Jul 10 18:58:25.908581 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:25.908552 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 18:58:25.908967 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:25.908940 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" event={"ID":"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f","Type":"ContainerStarted","Data":"68c24ed7675bc9e5d6ed65e7c6c47833e250f9d1907047ae8b7a93c3d3143caf"} Jul 10 18:58:25.923810 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:25.923773 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgq6s" podStartSLOduration=3.015485955 podStartE2EDuration="24.923759525s" totalImagesPullingTime="21.90827357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:25.923359123 +0000 UTC m=+25.675536841" watchObservedRunningTime="2026-07-10 18:58:25.923759525 +0000 UTC m=+25.675937244" Jul 10 18:58:27.715390 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:27.715177 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:27.715814 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:27.715208 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:27.715814 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:27.715491 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:27.715814 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:27.715250 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:27.715814 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:27.715594 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:27.715814 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:27.715630 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:28.917971 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:28.917766 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 18:58:28.918653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:28.918269 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" event={"ID":"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f","Type":"ContainerStarted","Data":"8db824dfc11bb3439b44782ef3849367c966f4a251ad6a53a216eb3cd65ca1e1"} Jul 10 18:58:28.918653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:28.918587 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:28.918653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:28.918641 2555 scope.go:117] "RemoveContainer" containerID="72701884df89aa6f10525afea49736460736986c33e3cd5ee8bbdd0ddd185800" Jul 10 18:58:28.918788 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:28.918664 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:28.918788 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:28.918712 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:28.920266 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:28.920216 2555 generic.go:356] "Generic (PLEG): container finished" podID="77d94732-b3cb-4630-8b2b-27e916f1e5ea" containerID="a599fbffc58d8aa48b8f51074ea4e90f764ce4c8b9f11bc2f7b850f39a603184" exitCode=0 Jul 10 18:58:28.920372 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:28.920266 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plnr2" event={"ID":"77d94732-b3cb-4630-8b2b-27e916f1e5ea","Type":"ContainerDied","Data":"a599fbffc58d8aa48b8f51074ea4e90f764ce4c8b9f11bc2f7b850f39a603184"} Jul 10 18:58:28.933576 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:28.933560 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:28.933665 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:28.933655 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:58:29.714730 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:29.714700 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:29.714730 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:29.714729 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:29.715058 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:29.714729 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:29.715058 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:29.714815 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:29.715058 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:29.714902 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:29.715058 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:29.714970 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:29.926460 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:29.926430 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 18:58:29.926872 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:29.926827 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" event={"ID":"1cac9ee7-9988-4a07-9561-af6ea5ef1f3f","Type":"ContainerStarted","Data":"9b9e6944a5d79a2dca362cdc38b218f0b5bf46bbb30eb0dc3cc0f8ae4f58fdfd"} Jul 10 18:58:29.961968 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:29.961927 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" podStartSLOduration=9.173571357 podStartE2EDuration="28.961914329s" totalImagesPullingTime="19.788342972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:29.961681771 +0000 UTC m=+29.713859489" watchObservedRunningTime="2026-07-10 18:58:29.961914329 +0000 UTC m=+29.714092047" Jul 10 18:58:30.387516 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:30.387447 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dsprs"] Jul 10 18:58:30.387639 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:30.387540 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:30.387639 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:30.387607 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:30.390975 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:30.390950 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xxv9h"] Jul 10 18:58:30.391091 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:30.391059 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:30.391167 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:30.391149 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:30.391638 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:30.391613 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4z4gc"] Jul 10 18:58:30.391704 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:30.391698 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:30.391792 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:30.391776 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:30.930327 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:30.930299 2555 generic.go:356] "Generic (PLEG): container finished" podID="77d94732-b3cb-4630-8b2b-27e916f1e5ea" containerID="46b63e7a7ac7c5bb81dccae6853cfdb65426ac9a8fa031f0fc0f8b01ebe12230" exitCode=0 Jul 10 18:58:30.930784 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:30.930383 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plnr2" event={"ID":"77d94732-b3cb-4630-8b2b-27e916f1e5ea","Type":"ContainerDied","Data":"46b63e7a7ac7c5bb81dccae6853cfdb65426ac9a8fa031f0fc0f8b01ebe12230"} Jul 10 18:58:31.715117 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:31.715083 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:31.715300 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:31.715098 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:31.715300 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:31.715205 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:31.715300 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:31.715271 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:32.714670 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:32.714428 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:32.714976 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:32.714732 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:32.936719 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:32.936684 2555 generic.go:356] "Generic (PLEG): container finished" podID="77d94732-b3cb-4630-8b2b-27e916f1e5ea" containerID="155fef8c682aa46693802f0a0b8c262f5c366c721f59ebc1554b3c703b19810d" exitCode=0 Jul 10 18:58:32.936849 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:32.936729 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plnr2" event={"ID":"77d94732-b3cb-4630-8b2b-27e916f1e5ea","Type":"ContainerDied","Data":"155fef8c682aa46693802f0a0b8c262f5c366c721f59ebc1554b3c703b19810d"} Jul 10 18:58:33.474718 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:33.474626 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:33.474897 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:33.474736 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:33.474897 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:33.474778 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:33.474897 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:33.474850 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret podName:6093f54c-d2e1-4752-a781-fec00493f97f nodeName:}" failed. No retries permitted until 2026-07-10 18:59:05.474831235 +0000 UTC m=+65.227008939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret") pod "global-pull-secret-syncer-xxv9h" (UID: "6093f54c-d2e1-4752-a781-fec00493f97f") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:58:33.474897 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:33.474878 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:33.475119 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:33.474955 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs podName:9668ee03-c888-4b72-96a5-f35850c46e12 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:05.474937722 +0000 UTC m=+65.227115423 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs") pod "network-metrics-daemon-4z4gc" (UID: "9668ee03-c888-4b72-96a5-f35850c46e12") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:58:33.576034 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:33.576002 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spzqc\" (UniqueName: \"kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc\") pod \"network-check-target-dsprs\" (UID: \"47b6ad13-974c-40f4-872a-473250c868f7\") " pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:33.576185 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:33.576142 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:58:33.576185 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:33.576159 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:58:33.576185 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:33.576172 2555 projected.go:196] Error preparing data for projected volume kube-api-access-spzqc for pod openshift-network-diagnostics/network-check-target-dsprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:33.576304 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:33.576244 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc podName:47b6ad13-974c-40f4-872a-473250c868f7 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:05.576211603 +0000 UTC m=+65.328389305 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-spzqc" (UniqueName: "kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc") pod "network-check-target-dsprs" (UID: "47b6ad13-974c-40f4-872a-473250c868f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:58:33.714758 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:33.714668 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:33.715182 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:33.714789 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z4gc" podUID="9668ee03-c888-4b72-96a5-f35850c46e12" Jul 10 18:58:33.715182 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:33.714842 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:33.715182 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:33.714929 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dsprs" podUID="47b6ad13-974c-40f4-872a-473250c868f7" Jul 10 18:58:34.714598 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:34.714512 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:34.717683 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:34.714983 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxv9h" podUID="6093f54c-d2e1-4752-a781-fec00493f97f" Jul 10 18:58:35.131783 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.131746 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-251.ec2.internal" event="NodeReady" Jul 10 18:58:35.131950 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.131874 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 18:58:35.194928 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.194895 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59c6f66b49-n2dpz"] Jul 10 18:58:35.196777 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.196755 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.204204 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.204184 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 18:58:35.204323 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.204182 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 18:58:35.205259 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.205222 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 18:58:35.205347 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.205267 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ndwz8\"" Jul 10 18:58:35.211150 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.211134 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 18:58:35.216969 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.216950 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cb9p4"] Jul 10 18:58:35.218792 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.218772 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c6f66b49-n2dpz"] Jul 10 18:58:35.218883 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.218871 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.221820 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.221801 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 18:58:35.222074 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.222026 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 18:58:35.222179 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.222092 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-99kdr\"" Jul 10 18:58:35.223729 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.223712 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xlrhj"] Jul 10 18:58:35.225584 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.225564 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xlrhj" Jul 10 18:58:35.228329 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.228192 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2w9vx\"" Jul 10 18:58:35.228329 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.228205 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 18:58:35.228329 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.228210 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 18:58:35.228519 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.228355 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 18:58:35.234284 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.234265 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cb9p4"] Jul 10 18:58:35.238104 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.238085 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xlrhj"] Jul 10 18:58:35.287557 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.287528 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtx2p\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-kube-api-access-xtx2p\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.287694 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.287568 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-certificates\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.287694 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.287635 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-installation-pull-secrets\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.287694 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.287661 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-bound-sa-token\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.287830 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.287702 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-image-registry-private-configuration\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.287830 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.287751 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.287830 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.287773 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/481f3727-cdfd-406c-a24b-c8c11afb093b-ca-trust-extracted\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.287830 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.287795 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-trusted-ca\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.388880 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.388820 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrbdj\" (UniqueName: \"kubernetes.io/projected/76648f19-b078-44a3-b39c-f12b7a772c99-kube-api-access-jrbdj\") pod \"ingress-canary-xlrhj\" (UID: \"76648f19-b078-44a3-b39c-f12b7a772c99\") " pod="openshift-ingress-canary/ingress-canary-xlrhj" Jul 10 18:58:35.388880 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.388853 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zszqx\" (UniqueName: \"kubernetes.io/projected/e07546b0-c428-47db-9643-3301abd4502d-kube-api-access-zszqx\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.389051 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.388939 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-installation-pull-secrets\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.389051 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.388968 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-bound-sa-token\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.389051 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.388990 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76648f19-b078-44a3-b39c-f12b7a772c99-cert\") pod \"ingress-canary-xlrhj\" (UID: \"76648f19-b078-44a3-b39c-f12b7a772c99\") " pod="openshift-ingress-canary/ingress-canary-xlrhj" Jul 10 18:58:35.389051 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.389018 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-image-registry-private-configuration\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.389051 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.389042 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e07546b0-c428-47db-9643-3301abd4502d-config-volume\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.389276 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.389067 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.389276 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.389082 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/481f3727-cdfd-406c-a24b-c8c11afb093b-ca-trust-extracted\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.389276 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.389104 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-trusted-ca\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.389276 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.389160 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtx2p\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-kube-api-access-xtx2p\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.389276 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:35.389173 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:58:35.389276 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.389181 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e07546b0-c428-47db-9643-3301abd4502d-tmp-dir\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.389276 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:35.389189 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c6f66b49-n2dpz: secret "image-registry-tls" not found Jul 10 18:58:35.389276 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.389207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-certificates\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.389276 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:35.389266 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls podName:481f3727-cdfd-406c-a24b-c8c11afb093b nodeName:}" failed. No retries permitted until 2026-07-10 18:58:35.889246505 +0000 UTC m=+35.641424218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls") pod "image-registry-59c6f66b49-n2dpz" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b") : secret "image-registry-tls" not found Jul 10 18:58:35.389576 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.389292 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.389929 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.389814 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-certificates\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.390153 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.390131 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/481f3727-cdfd-406c-a24b-c8c11afb093b-ca-trust-extracted\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.390380 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.390360 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-trusted-ca\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.393141 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.393121 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-image-registry-private-configuration\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.393225 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.393155 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-installation-pull-secrets\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.400608 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.400592 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-bound-sa-token\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.400830 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.400811 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtx2p\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-kube-api-access-xtx2p\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.490206 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.490182 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbdj\" (UniqueName: \"kubernetes.io/projected/76648f19-b078-44a3-b39c-f12b7a772c99-kube-api-access-jrbdj\") pod \"ingress-canary-xlrhj\" (UID: \"76648f19-b078-44a3-b39c-f12b7a772c99\") " pod="openshift-ingress-canary/ingress-canary-xlrhj" Jul 10 18:58:35.490206 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.490207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zszqx\" (UniqueName: \"kubernetes.io/projected/e07546b0-c428-47db-9643-3301abd4502d-kube-api-access-zszqx\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.490403 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.490258 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76648f19-b078-44a3-b39c-f12b7a772c99-cert\") pod \"ingress-canary-xlrhj\" (UID: \"76648f19-b078-44a3-b39c-f12b7a772c99\") " pod="openshift-ingress-canary/ingress-canary-xlrhj" Jul 10 18:58:35.490403 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.490280 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e07546b0-c428-47db-9643-3301abd4502d-config-volume\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.490403 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.490342 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e07546b0-c428-47db-9643-3301abd4502d-tmp-dir\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.490403 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.490367 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.490598 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:35.490520 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:58:35.490598 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:35.490582 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls podName:e07546b0-c428-47db-9643-3301abd4502d nodeName:}" failed. No retries permitted until 2026-07-10 18:58:35.990562428 +0000 UTC m=+35.742740128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls") pod "dns-default-cb9p4" (UID: "e07546b0-c428-47db-9643-3301abd4502d") : secret "dns-default-metrics-tls" not found Jul 10 18:58:35.490763 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.490737 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e07546b0-c428-47db-9643-3301abd4502d-tmp-dir\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.490935 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.490912 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e07546b0-c428-47db-9643-3301abd4502d-config-volume\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.492789 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.492770 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76648f19-b078-44a3-b39c-f12b7a772c99-cert\") pod \"ingress-canary-xlrhj\" (UID: \"76648f19-b078-44a3-b39c-f12b7a772c99\") " pod="openshift-ingress-canary/ingress-canary-xlrhj" Jul 10 18:58:35.503516 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.502548 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zszqx\" (UniqueName: \"kubernetes.io/projected/e07546b0-c428-47db-9643-3301abd4502d-kube-api-access-zszqx\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.504989 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.504970 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbdj\" (UniqueName: \"kubernetes.io/projected/76648f19-b078-44a3-b39c-f12b7a772c99-kube-api-access-jrbdj\") pod \"ingress-canary-xlrhj\" (UID: \"76648f19-b078-44a3-b39c-f12b7a772c99\") " pod="openshift-ingress-canary/ingress-canary-xlrhj" Jul 10 18:58:35.535628 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.535603 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xlrhj" Jul 10 18:58:35.619419 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.619385 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pz6wd_9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:35.706404 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.706332 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pz6wd_9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:35.715341 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.715319 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:58:35.715524 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.715501 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:58:35.718198 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.718161 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:58:35.718774 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.718297 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k2x45\"" Jul 10 18:58:35.718774 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.718439 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 18:58:35.718774 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.718669 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xvd26\"" Jul 10 18:58:35.718774 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.718712 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 18:58:35.893929 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.893893 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:35.894102 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:35.894034 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:58:35.894102 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:35.894048 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c6f66b49-n2dpz: secret "image-registry-tls" not found Jul 10 18:58:35.894204 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:35.894109 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls podName:481f3727-cdfd-406c-a24b-c8c11afb093b nodeName:}" failed. No retries permitted until 2026-07-10 18:58:36.894091075 +0000 UTC m=+36.646268773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls") pod "image-registry-59c6f66b49-n2dpz" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b") : secret "image-registry-tls" not found Jul 10 18:58:35.995363 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:35.995270 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:35.995522 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:35.995439 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:58:35.995582 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:35.995528 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls podName:e07546b0-c428-47db-9643-3301abd4502d nodeName:}" failed. No retries permitted until 2026-07-10 18:58:36.995504507 +0000 UTC m=+36.747682232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls") pod "dns-default-cb9p4" (UID: "e07546b0-c428-47db-9643-3301abd4502d") : secret "dns-default-metrics-tls" not found Jul 10 18:58:36.014965 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:36.014930 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pz6wd_9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:36.115371 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:36.115332 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pz6wd_9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:36.718384 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:36.718368 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:58:36.721383 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:36.721336 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:58:36.757648 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:36.757625 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xlrhj"] Jul 10 18:58:36.761434 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:58:36.761413 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76648f19_b078_44a3_b39c_f12b7a772c99.slice/crio-9a48e5468edbd8284483fff235e7c7f03cd3fc48dcdf3c4e9561baf8a225c80e WatchSource:0}: Error finding container 9a48e5468edbd8284483fff235e7c7f03cd3fc48dcdf3c4e9561baf8a225c80e: Status 404 returned error can't find the container with id 9a48e5468edbd8284483fff235e7c7f03cd3fc48dcdf3c4e9561baf8a225c80e Jul 10 18:58:36.903113 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:36.903036 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:36.903208 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:36.903190 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:58:36.903265 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:36.903209 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c6f66b49-n2dpz: secret "image-registry-tls" not found Jul 10 18:58:36.903305 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:36.903279 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls podName:481f3727-cdfd-406c-a24b-c8c11afb093b nodeName:}" failed. No retries permitted until 2026-07-10 18:58:38.903263004 +0000 UTC m=+38.655440701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls") pod "image-registry-59c6f66b49-n2dpz" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b") : secret "image-registry-tls" not found Jul 10 18:58:36.948747 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:36.948724 2555 generic.go:356] "Generic (PLEG): container finished" podID="77d94732-b3cb-4630-8b2b-27e916f1e5ea" containerID="10c0ca0eecb9bc76ffdfd1dd33d225d8a9747548667b682356da00b32ad2f36f" exitCode=0 Jul 10 18:58:36.948834 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:36.948799 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plnr2" event={"ID":"77d94732-b3cb-4630-8b2b-27e916f1e5ea","Type":"ContainerDied","Data":"10c0ca0eecb9bc76ffdfd1dd33d225d8a9747548667b682356da00b32ad2f36f"} Jul 10 18:58:36.949863 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:36.949842 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xlrhj" event={"ID":"76648f19-b078-44a3-b39c-f12b7a772c99","Type":"ContainerStarted","Data":"9a48e5468edbd8284483fff235e7c7f03cd3fc48dcdf3c4e9561baf8a225c80e"} Jul 10 18:58:37.003975 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:37.003947 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:37.004100 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:37.004085 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:58:37.004147 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:37.004138 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls podName:e07546b0-c428-47db-9643-3301abd4502d nodeName:}" failed. No retries permitted until 2026-07-10 18:58:39.004123075 +0000 UTC m=+38.756300780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls") pod "dns-default-cb9p4" (UID: "e07546b0-c428-47db-9643-3301abd4502d") : secret "dns-default-metrics-tls" not found Jul 10 18:58:37.955481 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:37.955443 2555 generic.go:356] "Generic (PLEG): container finished" podID="77d94732-b3cb-4630-8b2b-27e916f1e5ea" containerID="548ace9dad1280f7d9eee3edb3e07a872ffc3d1e14be73d582e994d0b564d4e0" exitCode=0 Jul 10 18:58:37.955481 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:37.955482 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plnr2" event={"ID":"77d94732-b3cb-4630-8b2b-27e916f1e5ea","Type":"ContainerDied","Data":"548ace9dad1280f7d9eee3edb3e07a872ffc3d1e14be73d582e994d0b564d4e0"} Jul 10 18:58:38.915272 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:38.915218 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:38.915474 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:38.915380 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:58:38.915474 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:38.915403 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c6f66b49-n2dpz: secret "image-registry-tls" not found Jul 10 18:58:38.915474 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:38.915467 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls podName:481f3727-cdfd-406c-a24b-c8c11afb093b nodeName:}" failed. No retries permitted until 2026-07-10 18:58:42.91545137 +0000 UTC m=+42.667629068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls") pod "image-registry-59c6f66b49-n2dpz" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b") : secret "image-registry-tls" not found Jul 10 18:58:38.962414 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:38.962380 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plnr2" event={"ID":"77d94732-b3cb-4630-8b2b-27e916f1e5ea","Type":"ContainerStarted","Data":"4a1c71bb11e775e3a9435754bc30b999f9e5d1360d5b42db0fbd8c1ba2de9311"} Jul 10 18:58:38.991122 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:38.991079 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-plnr2" podStartSLOduration=7.507508467 podStartE2EDuration="37.991063789s" totalImagesPullingTime="30.483555322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:38.99045203 +0000 UTC m=+38.742629748" watchObservedRunningTime="2026-07-10 18:58:38.991063789 +0000 UTC m=+38.743241508" Jul 10 18:58:39.016594 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:39.016573 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:39.016723 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:39.016707 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:58:39.016770 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:39.016761 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls podName:e07546b0-c428-47db-9643-3301abd4502d nodeName:}" failed. No retries permitted until 2026-07-10 18:58:43.016749036 +0000 UTC m=+42.768926748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls") pod "dns-default-cb9p4" (UID: "e07546b0-c428-47db-9643-3301abd4502d") : secret "dns-default-metrics-tls" not found Jul 10 18:58:39.114159 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:39.114126 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pz6wd_9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:39.214383 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:39.214287 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pz6wd_9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:39.580820 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:39.580754 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pz6wd_9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:39.649045 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:39.649011 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pz6wd_9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:39.965920 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:39.965892 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xlrhj" event={"ID":"76648f19-b078-44a3-b39c-f12b7a772c99","Type":"ContainerStarted","Data":"f9c3aac0110cbdee39e304c701af818c14ad8f2bf3ed5b71d03e9a3ea568f5ba"} Jul 10 18:58:39.986665 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:39.986626 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xlrhj" podStartSLOduration=2.337204788 podStartE2EDuration="4.986611356s" totalImagesPullingTime="2.649406568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:39.985726196 +0000 UTC m=+39.737903916" watchObservedRunningTime="2026-07-10 18:58:39.986611356 +0000 UTC m=+39.738789092" Jul 10 18:58:40.378593 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:40.378561 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pz6wd_9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:40.442986 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:40.442959 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pz6wd_9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:42.941241 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:42.941203 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:42.941688 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:42.941399 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:58:42.941688 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:42.941424 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c6f66b49-n2dpz: secret "image-registry-tls" not found Jul 10 18:58:42.941688 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:42.941493 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls podName:481f3727-cdfd-406c-a24b-c8c11afb093b nodeName:}" failed. No retries permitted until 2026-07-10 18:58:50.941472806 +0000 UTC m=+50.693650516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls") pod "image-registry-59c6f66b49-n2dpz" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b") : secret "image-registry-tls" not found Jul 10 18:58:43.042173 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:43.042151 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:43.042326 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:43.042301 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:58:43.042382 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:43.042358 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls podName:e07546b0-c428-47db-9643-3301abd4502d nodeName:}" failed. No retries permitted until 2026-07-10 18:58:51.042341324 +0000 UTC m=+50.794519023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls") pod "dns-default-cb9p4" (UID: "e07546b0-c428-47db-9643-3301abd4502d") : secret "dns-default-metrics-tls" not found Jul 10 18:58:50.997954 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:50.997917 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:58:50.998402 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:50.998025 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:58:50.998402 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:50.998036 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c6f66b49-n2dpz: secret "image-registry-tls" not found Jul 10 18:58:50.998402 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:50.998081 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls podName:481f3727-cdfd-406c-a24b-c8c11afb093b nodeName:}" failed. No retries permitted until 2026-07-10 18:59:06.998067645 +0000 UTC m=+66.750245343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls") pod "image-registry-59c6f66b49-n2dpz" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b") : secret "image-registry-tls" not found Jul 10 18:58:51.099009 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:58:51.098973 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:58:51.099154 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:51.099075 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:58:51.099154 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:58:51.099131 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls podName:e07546b0-c428-47db-9643-3301abd4502d nodeName:}" failed. No retries permitted until 2026-07-10 18:59:07.099118999 +0000 UTC m=+66.851296696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls") pod "dns-default-cb9p4" (UID: "e07546b0-c428-47db-9643-3301abd4502d") : secret "dns-default-metrics-tls" not found Jul 10 18:59:00.940931 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:00.940907 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-29w9l" Jul 10 18:59:04.243274 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.243221 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j"] Jul 10 18:59:04.245971 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.245953 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s"] Jul 10 18:59:04.246088 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.246070 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" Jul 10 18:59:04.247430 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.247415 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:04.248869 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.248853 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 10 18:59:04.249165 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.249151 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 10 18:59:04.249243 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.249215 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-t2fl9\"" Jul 10 18:59:04.249303 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.249250 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 10 18:59:04.249358 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.249345 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:59:04.252007 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.251980 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 10 18:59:04.252102 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.252015 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 18:59:04.252102 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.252064 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6hpg4\"" Jul 10 18:59:04.252102 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.252064 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 18:59:04.252269 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.252184 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 10 18:59:04.260686 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.260617 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s"] Jul 10 18:59:04.261346 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.261326 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j"] Jul 10 18:59:04.295007 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.294987 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c7lf\" (UniqueName: \"kubernetes.io/projected/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-kube-api-access-4c7lf\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:04.295099 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.295024 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:04.295099 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.295043 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3977581c-775c-498f-ae9a-965374e9d5c4-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-p687j\" (UID: \"3977581c-775c-498f-ae9a-965374e9d5c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" Jul 10 18:59:04.295099 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.295061 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shcl4\" (UniqueName: \"kubernetes.io/projected/3977581c-775c-498f-ae9a-965374e9d5c4-kube-api-access-shcl4\") pod \"kube-storage-version-migrator-operator-799cb7f958-p687j\" (UID: \"3977581c-775c-498f-ae9a-965374e9d5c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" Jul 10 18:59:04.295195 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.295141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:04.295195 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.295180 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3977581c-775c-498f-ae9a-965374e9d5c4-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-p687j\" (UID: \"3977581c-775c-498f-ae9a-965374e9d5c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" Jul 10 18:59:04.396186 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.396157 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:04.396334 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.396202 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3977581c-775c-498f-ae9a-965374e9d5c4-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-p687j\" (UID: \"3977581c-775c-498f-ae9a-965374e9d5c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" Jul 10 18:59:04.396334 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.396267 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c7lf\" (UniqueName: \"kubernetes.io/projected/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-kube-api-access-4c7lf\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:04.396334 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.396300 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:04.396334 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:04.396328 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:04.396481 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:04.396402 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls podName:cdda9f04-4c6f-4e4f-a8b2-93522e87eea5 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:04.896383862 +0000 UTC m=+64.648561566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-b8s7s" (UID: "cdda9f04-4c6f-4e4f-a8b2-93522e87eea5") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:04.396481 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.396329 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3977581c-775c-498f-ae9a-965374e9d5c4-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-p687j\" (UID: \"3977581c-775c-498f-ae9a-965374e9d5c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" Jul 10 18:59:04.396564 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.396477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shcl4\" (UniqueName: \"kubernetes.io/projected/3977581c-775c-498f-ae9a-965374e9d5c4-kube-api-access-shcl4\") pod \"kube-storage-version-migrator-operator-799cb7f958-p687j\" (UID: \"3977581c-775c-498f-ae9a-965374e9d5c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" Jul 10 18:59:04.396848 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.396825 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3977581c-775c-498f-ae9a-965374e9d5c4-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-p687j\" (UID: \"3977581c-775c-498f-ae9a-965374e9d5c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" Jul 10 18:59:04.397005 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.396987 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:04.399777 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.399752 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3977581c-775c-498f-ae9a-965374e9d5c4-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-p687j\" (UID: \"3977581c-775c-498f-ae9a-965374e9d5c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" Jul 10 18:59:04.412711 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.412682 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c7lf\" (UniqueName: \"kubernetes.io/projected/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-kube-api-access-4c7lf\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:04.420666 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.420646 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shcl4\" (UniqueName: \"kubernetes.io/projected/3977581c-775c-498f-ae9a-965374e9d5c4-kube-api-access-shcl4\") pod \"kube-storage-version-migrator-operator-799cb7f958-p687j\" (UID: \"3977581c-775c-498f-ae9a-965374e9d5c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" Jul 10 18:59:04.557343 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.557262 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" Jul 10 18:59:04.689089 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.688998 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j"] Jul 10 18:59:04.691373 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:04.691345 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3977581c_775c_498f_ae9a_965374e9d5c4.slice/crio-7a89cdda0f4d86eef6aa33a4c5001444614c09911453de2ec937b8efbd6a4b1c WatchSource:0}: Error finding container 7a89cdda0f4d86eef6aa33a4c5001444614c09911453de2ec937b8efbd6a4b1c: Status 404 returned error can't find the container with id 7a89cdda0f4d86eef6aa33a4c5001444614c09911453de2ec937b8efbd6a4b1c Jul 10 18:59:04.899456 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:04.899425 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:04.899618 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:04.899581 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:04.899664 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:04.899654 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls podName:cdda9f04-4c6f-4e4f-a8b2-93522e87eea5 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:05.899639386 +0000 UTC m=+65.651817083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-b8s7s" (UID: "cdda9f04-4c6f-4e4f-a8b2-93522e87eea5") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:05.023515 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.023477 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" event={"ID":"3977581c-775c-498f-ae9a-965374e9d5c4","Type":"ContainerStarted","Data":"7a89cdda0f4d86eef6aa33a4c5001444614c09911453de2ec937b8efbd6a4b1c"} Jul 10 18:59:05.504192 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.504154 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 18:59:05.504634 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.504306 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:59:05.507286 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.507260 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:59:05.507409 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.507301 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:59:05.514595 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:05.514569 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 18:59:05.514710 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:05.514646 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs podName:9668ee03-c888-4b72-96a5-f35850c46e12 nodeName:}" failed. No retries permitted until 2026-07-10 19:00:09.514623374 +0000 UTC m=+129.266801090 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs") pod "network-metrics-daemon-4z4gc" (UID: "9668ee03-c888-4b72-96a5-f35850c46e12") : secret "metrics-daemon-secret" not found Jul 10 18:59:05.516965 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.516945 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6093f54c-d2e1-4752-a781-fec00493f97f-original-pull-secret\") pod \"global-pull-secret-syncer-xxv9h\" (UID: \"6093f54c-d2e1-4752-a781-fec00493f97f\") " pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:59:05.542308 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.542275 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxv9h" Jul 10 18:59:05.605499 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.605465 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spzqc\" (UniqueName: \"kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc\") pod \"network-check-target-dsprs\" (UID: \"47b6ad13-974c-40f4-872a-473250c868f7\") " pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:59:05.608430 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.608395 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 18:59:05.618704 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.618515 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 18:59:05.628744 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.628724 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spzqc\" (UniqueName: \"kubernetes.io/projected/47b6ad13-974c-40f4-872a-473250c868f7-kube-api-access-spzqc\") pod \"network-check-target-dsprs\" (UID: \"47b6ad13-974c-40f4-872a-473250c868f7\") " pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:59:05.668501 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.668402 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xxv9h"] Jul 10 18:59:05.670929 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:05.670897 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6093f54c_d2e1_4752_a781_fec00493f97f.slice/crio-4f4536db51a05415014118918e3126f8137e1bfb990e3297c1b9d75eb2a3ae19 WatchSource:0}: Error finding container 4f4536db51a05415014118918e3126f8137e1bfb990e3297c1b9d75eb2a3ae19: Status 404 returned error can't find the container with id 4f4536db51a05415014118918e3126f8137e1bfb990e3297c1b9d75eb2a3ae19 Jul 10 18:59:05.734898 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.734865 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k2x45\"" Jul 10 18:59:05.741409 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.741386 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:59:05.866090 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.866067 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dsprs"] Jul 10 18:59:05.868372 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:05.868346 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b6ad13_974c_40f4_872a_473250c868f7.slice/crio-babdf512d95d01fa2a50543f8621899258d3bca32ca14e3b1095823ea4f54044 WatchSource:0}: Error finding container babdf512d95d01fa2a50543f8621899258d3bca32ca14e3b1095823ea4f54044: Status 404 returned error can't find the container with id babdf512d95d01fa2a50543f8621899258d3bca32ca14e3b1095823ea4f54044 Jul 10 18:59:05.908418 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:05.908395 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:05.908549 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:05.908531 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:05.908594 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:05.908587 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls podName:cdda9f04-4c6f-4e4f-a8b2-93522e87eea5 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:07.908573236 +0000 UTC m=+67.660750934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-b8s7s" (UID: "cdda9f04-4c6f-4e4f-a8b2-93522e87eea5") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:06.027010 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.026975 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dsprs" event={"ID":"47b6ad13-974c-40f4-872a-473250c868f7","Type":"ContainerStarted","Data":"babdf512d95d01fa2a50543f8621899258d3bca32ca14e3b1095823ea4f54044"} Jul 10 18:59:06.028016 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.027981 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xxv9h" event={"ID":"6093f54c-d2e1-4752-a781-fec00493f97f","Type":"ContainerStarted","Data":"4f4536db51a05415014118918e3126f8137e1bfb990e3297c1b9d75eb2a3ae19"} Jul 10 18:59:06.031438 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.031416 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x"] Jul 10 18:59:06.034004 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.033985 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" Jul 10 18:59:06.037086 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.037031 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 10 18:59:06.037086 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.037038 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 10 18:59:06.037086 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.037082 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 10 18:59:06.037224 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.037057 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vbrcd\"" Jul 10 18:59:06.037224 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.037040 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:59:06.044795 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.044775 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x"] Jul 10 18:59:06.109220 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.109182 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zhm4x\" (UID: \"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" Jul 10 18:59:06.109395 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.109225 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db-config\") pod \"service-ca-operator-7695fc6c8c-zhm4x\" (UID: \"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" Jul 10 18:59:06.109395 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.109344 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lj4g\" (UniqueName: \"kubernetes.io/projected/a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db-kube-api-access-7lj4g\") pod \"service-ca-operator-7695fc6c8c-zhm4x\" (UID: \"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" Jul 10 18:59:06.210388 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.210350 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db-config\") pod \"service-ca-operator-7695fc6c8c-zhm4x\" (UID: \"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" Jul 10 18:59:06.210547 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.210424 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lj4g\" (UniqueName: \"kubernetes.io/projected/a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db-kube-api-access-7lj4g\") pod \"service-ca-operator-7695fc6c8c-zhm4x\" (UID: \"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" Jul 10 18:59:06.210547 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.210523 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zhm4x\" (UID: \"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" Jul 10 18:59:06.210935 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.210912 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db-config\") pod \"service-ca-operator-7695fc6c8c-zhm4x\" (UID: \"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" Jul 10 18:59:06.212566 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.212548 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zhm4x\" (UID: \"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" Jul 10 18:59:06.219561 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.219535 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lj4g\" (UniqueName: \"kubernetes.io/projected/a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db-kube-api-access-7lj4g\") pod \"service-ca-operator-7695fc6c8c-zhm4x\" (UID: \"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" Jul 10 18:59:06.342886 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.342857 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" Jul 10 18:59:06.472637 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:06.472605 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x"] Jul 10 18:59:06.475792 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:06.475756 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5eee2d5_e1c2_4f53_abfd_707c5e9ca1db.slice/crio-13c375474ceb1759d990d09c8653beca3c86b961cf2873ed422acf5b769a6583 WatchSource:0}: Error finding container 13c375474ceb1759d990d09c8653beca3c86b961cf2873ed422acf5b769a6583: Status 404 returned error can't find the container with id 13c375474ceb1759d990d09c8653beca3c86b961cf2873ed422acf5b769a6583 Jul 10 18:59:07.017732 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:07.017568 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:59:07.018178 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:07.017758 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:59:07.018178 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:07.017774 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c6f66b49-n2dpz: secret "image-registry-tls" not found Jul 10 18:59:07.018178 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:07.017833 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls podName:481f3727-cdfd-406c-a24b-c8c11afb093b nodeName:}" failed. No retries permitted until 2026-07-10 18:59:39.017813864 +0000 UTC m=+98.769991578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls") pod "image-registry-59c6f66b49-n2dpz" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b") : secret "image-registry-tls" not found Jul 10 18:59:07.032569 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:07.032531 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" event={"ID":"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db","Type":"ContainerStarted","Data":"13c375474ceb1759d990d09c8653beca3c86b961cf2873ed422acf5b769a6583"} Jul 10 18:59:07.118532 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:07.118491 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:59:07.118708 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:07.118652 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:59:07.118771 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:07.118712 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls podName:e07546b0-c428-47db-9643-3301abd4502d nodeName:}" failed. No retries permitted until 2026-07-10 18:59:39.118694612 +0000 UTC m=+98.870872312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls") pod "dns-default-cb9p4" (UID: "e07546b0-c428-47db-9643-3301abd4502d") : secret "dns-default-metrics-tls" not found Jul 10 18:59:07.927397 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:07.927357 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:07.927599 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:07.927585 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:07.927671 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:07.927649 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls podName:cdda9f04-4c6f-4e4f-a8b2-93522e87eea5 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:11.927630001 +0000 UTC m=+71.679807700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-b8s7s" (UID: "cdda9f04-4c6f-4e4f-a8b2-93522e87eea5") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:08.038093 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:08.038048 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" event={"ID":"3977581c-775c-498f-ae9a-965374e9d5c4","Type":"ContainerStarted","Data":"46e6684097536bd9af089196d24ebc457bad8ab0626ea2a1bae568edc4567eb9"} Jul 10 18:59:08.058406 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:08.057944 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" podStartSLOduration=1.617429071 podStartE2EDuration="4.057923612s" totalImagesPullingTime="2.440494541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:08.056820423 +0000 UTC m=+67.808998142" watchObservedRunningTime="2026-07-10 18:59:08.057923612 +0000 UTC m=+67.810101331" Jul 10 18:59:08.580480 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:08.580411 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-w4tzb"] Jul 10 18:59:08.601910 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:08.601872 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-w4tzb"] Jul 10 18:59:08.602068 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:08.601990 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w4tzb" Jul 10 18:59:08.606125 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:08.606102 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-s9hkb\"" Jul 10 18:59:08.633869 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:08.633820 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk86k\" (UniqueName: \"kubernetes.io/projected/449560c7-401e-4142-877b-9e5551173711-kube-api-access-zk86k\") pod \"network-check-source-869dcfcdcd-w4tzb\" (UID: \"449560c7-401e-4142-877b-9e5551173711\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w4tzb" Jul 10 18:59:08.734866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:08.734826 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk86k\" (UniqueName: \"kubernetes.io/projected/449560c7-401e-4142-877b-9e5551173711-kube-api-access-zk86k\") pod \"network-check-source-869dcfcdcd-w4tzb\" (UID: \"449560c7-401e-4142-877b-9e5551173711\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w4tzb" Jul 10 18:59:08.744854 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:08.744823 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk86k\" (UniqueName: \"kubernetes.io/projected/449560c7-401e-4142-877b-9e5551173711-kube-api-access-zk86k\") pod \"network-check-source-869dcfcdcd-w4tzb\" (UID: \"449560c7-401e-4142-877b-9e5551173711\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w4tzb" Jul 10 18:59:08.911835 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:08.911741 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w4tzb" Jul 10 18:59:09.172538 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.172459 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7"] Jul 10 18:59:09.189307 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.189283 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7"] Jul 10 18:59:09.189458 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.189395 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7" Jul 10 18:59:09.192468 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.192440 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 10 18:59:09.192618 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.192596 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4z84n\"" Jul 10 18:59:09.192692 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.192606 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 10 18:59:09.238793 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.238766 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pthwm\" (UniqueName: \"kubernetes.io/projected/a38b7489-9cbe-4870-8584-baf143e3d918-kube-api-access-pthwm\") pod \"migrator-7f59b54f6c-kttl7\" (UID: \"a38b7489-9cbe-4870-8584-baf143e3d918\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7" Jul 10 18:59:09.340208 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.340172 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pthwm\" (UniqueName: \"kubernetes.io/projected/a38b7489-9cbe-4870-8584-baf143e3d918-kube-api-access-pthwm\") pod \"migrator-7f59b54f6c-kttl7\" (UID: \"a38b7489-9cbe-4870-8584-baf143e3d918\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7" Jul 10 18:59:09.353149 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.353127 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pthwm\" (UniqueName: \"kubernetes.io/projected/a38b7489-9cbe-4870-8584-baf143e3d918-kube-api-access-pthwm\") pod \"migrator-7f59b54f6c-kttl7\" (UID: \"a38b7489-9cbe-4870-8584-baf143e3d918\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7" Jul 10 18:59:09.500467 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.500389 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7" Jul 10 18:59:09.607471 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.607440 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jdk7n"] Jul 10 18:59:09.622708 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.622669 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.623943 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.623921 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jdk7n"] Jul 10 18:59:09.627877 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.627860 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2qznj\"" Jul 10 18:59:09.627998 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.627976 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 18:59:09.628071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.628036 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 18:59:09.628071 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.627984 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 18:59:09.628671 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.628652 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 18:59:09.744661 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.744622 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.744876 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.744679 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0589b4ec-92dd-4ae5-a06d-196972da25bd-crio-socket\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.744876 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.744753 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.744876 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.744804 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0589b4ec-92dd-4ae5-a06d-196972da25bd-data-volume\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.745016 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.744911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svkl5\" (UniqueName: \"kubernetes.io/projected/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-api-access-svkl5\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.845818 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.845775 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.846008 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.845847 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0589b4ec-92dd-4ae5-a06d-196972da25bd-data-volume\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.846008 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.845927 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svkl5\" (UniqueName: \"kubernetes.io/projected/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-api-access-svkl5\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.846008 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:09.845956 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:59:09.846148 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:09.846030 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls podName:0589b4ec-92dd-4ae5-a06d-196972da25bd nodeName:}" failed. No retries permitted until 2026-07-10 18:59:10.346011707 +0000 UTC m=+70.098189422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdk7n" (UID: "0589b4ec-92dd-4ae5-a06d-196972da25bd") : secret "insights-runtime-extractor-tls" not found Jul 10 18:59:09.846214 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.846148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.846302 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.846244 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0589b4ec-92dd-4ae5-a06d-196972da25bd-crio-socket\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.846302 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.846285 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0589b4ec-92dd-4ae5-a06d-196972da25bd-data-volume\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.846398 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:09.846288 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:59:09.846398 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.846358 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0589b4ec-92dd-4ae5-a06d-196972da25bd-crio-socket\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:09.846398 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:09.846382 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm podName:0589b4ec-92dd-4ae5-a06d-196972da25bd nodeName:}" failed. No retries permitted until 2026-07-10 18:59:10.346363648 +0000 UTC m=+70.098541355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdk7n" (UID: "0589b4ec-92dd-4ae5-a06d-196972da25bd") : configmap "kube-rbac-proxy" not found Jul 10 18:59:09.856639 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:09.856604 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svkl5\" (UniqueName: \"kubernetes.io/projected/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-api-access-svkl5\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:10.351035 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:10.351000 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:10.351512 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:10.351065 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:10.351512 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:10.351131 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:59:10.351512 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:10.351206 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:59:10.351512 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:10.351255 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm podName:0589b4ec-92dd-4ae5-a06d-196972da25bd nodeName:}" failed. No retries permitted until 2026-07-10 18:59:11.351223157 +0000 UTC m=+71.103400871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdk7n" (UID: "0589b4ec-92dd-4ae5-a06d-196972da25bd") : configmap "kube-rbac-proxy" not found Jul 10 18:59:10.351512 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:10.351301 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls podName:0589b4ec-92dd-4ae5-a06d-196972da25bd nodeName:}" failed. No retries permitted until 2026-07-10 18:59:11.351281491 +0000 UTC m=+71.103459192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdk7n" (UID: "0589b4ec-92dd-4ae5-a06d-196972da25bd") : secret "insights-runtime-extractor-tls" not found Jul 10 18:59:11.359270 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:11.359220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:11.359695 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:11.359341 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:11.359695 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:11.359376 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:59:11.359695 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:11.359419 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:59:11.359695 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:11.359443 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls podName:0589b4ec-92dd-4ae5-a06d-196972da25bd nodeName:}" failed. No retries permitted until 2026-07-10 18:59:13.359425859 +0000 UTC m=+73.111603560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdk7n" (UID: "0589b4ec-92dd-4ae5-a06d-196972da25bd") : secret "insights-runtime-extractor-tls" not found Jul 10 18:59:11.359695 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:11.359467 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm podName:0589b4ec-92dd-4ae5-a06d-196972da25bd nodeName:}" failed. No retries permitted until 2026-07-10 18:59:13.359456829 +0000 UTC m=+73.111634526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdk7n" (UID: "0589b4ec-92dd-4ae5-a06d-196972da25bd") : configmap "kube-rbac-proxy" not found Jul 10 18:59:11.635908 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:11.635882 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-w4tzb"] Jul 10 18:59:11.639639 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:11.639614 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449560c7_401e_4142_877b_9e5551173711.slice/crio-9844ed5e87d74ee875593a24979c444d8bdbc49426156fd2db9893e7faff6ad2 WatchSource:0}: Error finding container 9844ed5e87d74ee875593a24979c444d8bdbc49426156fd2db9893e7faff6ad2: Status 404 returned error can't find the container with id 9844ed5e87d74ee875593a24979c444d8bdbc49426156fd2db9893e7faff6ad2 Jul 10 18:59:11.660545 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:11.660524 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7"] Jul 10 18:59:11.665456 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:11.665428 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38b7489_9cbe_4870_8584_baf143e3d918.slice/crio-b56c1dbc066207123348916e3c4546004622c22a2bd1c1f8d7b60fb87e3a02dc WatchSource:0}: Error finding container b56c1dbc066207123348916e3c4546004622c22a2bd1c1f8d7b60fb87e3a02dc: Status 404 returned error can't find the container with id b56c1dbc066207123348916e3c4546004622c22a2bd1c1f8d7b60fb87e3a02dc Jul 10 18:59:11.806711 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:11.806673 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jfrgv_c3874646-e1df-44b0-9c8d-33ec78921823/dns-node-resolver/0.log" Jul 10 18:59:11.966951 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:11.966869 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:11.967108 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:11.966983 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:11.967108 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:11.967032 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls podName:cdda9f04-4c6f-4e4f-a8b2-93522e87eea5 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:19.967018829 +0000 UTC m=+79.719196526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-b8s7s" (UID: "cdda9f04-4c6f-4e4f-a8b2-93522e87eea5") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:12.049701 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.049667 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dsprs" event={"ID":"47b6ad13-974c-40f4-872a-473250c868f7","Type":"ContainerStarted","Data":"4dffbb50868f90f27f4d15c7c12f7600dd39349f4d712ad8e32a16c9664574e9"} Jul 10 18:59:12.049888 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.049872 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:59:12.050811 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.050790 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7" event={"ID":"a38b7489-9cbe-4870-8584-baf143e3d918","Type":"ContainerStarted","Data":"b56c1dbc066207123348916e3c4546004622c22a2bd1c1f8d7b60fb87e3a02dc"} Jul 10 18:59:12.052212 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.052193 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w4tzb" event={"ID":"449560c7-401e-4142-877b-9e5551173711","Type":"ContainerStarted","Data":"b07d430e2d83e1f35d1e2aba84925017a9789ccaad2c2fa51f5ae5ec3b2b4c1d"} Jul 10 18:59:12.052323 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.052249 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w4tzb" event={"ID":"449560c7-401e-4142-877b-9e5551173711","Type":"ContainerStarted","Data":"9844ed5e87d74ee875593a24979c444d8bdbc49426156fd2db9893e7faff6ad2"} Jul 10 18:59:12.053662 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.053642 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" event={"ID":"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db","Type":"ContainerStarted","Data":"52a340e5c845a1b7478bf7d4613489b4a48f0c79612f13d1b97a83fa4e8c3675"} Jul 10 18:59:12.055007 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.054989 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xxv9h" event={"ID":"6093f54c-d2e1-4752-a781-fec00493f97f","Type":"ContainerStarted","Data":"c036fbea8c58b4e79475c64dc449e66f4cdea0dd929920b6f9107ef463249323"} Jul 10 18:59:12.086950 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.086913 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dsprs" podStartSLOduration=65.468374324 podStartE2EDuration="1m11.086902365s" totalImagesPullingTime="5.618528041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:12.085645645 +0000 UTC m=+71.837823363" watchObservedRunningTime="2026-07-10 18:59:12.086902365 +0000 UTC m=+71.839080062" Jul 10 18:59:12.114964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.114920 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" podStartSLOduration=1.104237179 podStartE2EDuration="6.114910043s" totalImagesPullingTime="5.010672864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:12.11411325 +0000 UTC m=+71.866290969" watchObservedRunningTime="2026-07-10 18:59:12.114910043 +0000 UTC m=+71.867087762" Jul 10 18:59:12.137573 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.137525 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xxv9h" podStartSLOduration=65.303501177 podStartE2EDuration="1m11.137507201s" totalImagesPullingTime="5.834006024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:12.137109656 +0000 UTC m=+71.889287377" watchObservedRunningTime="2026-07-10 18:59:12.137507201 +0000 UTC m=+71.889684920" Jul 10 18:59:12.154694 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.154409 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w4tzb" podStartSLOduration=4.154393195 podStartE2EDuration="4.154393195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:12.153536956 +0000 UTC m=+71.905714676" watchObservedRunningTime="2026-07-10 18:59:12.154393195 +0000 UTC m=+71.906570916" Jul 10 18:59:12.806769 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:12.806749 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hsg7h_85503e38-dcb0-4845-9510-cb8847afef80/node-ca/0.log" Jul 10 18:59:13.060276 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:13.060163 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7" event={"ID":"a38b7489-9cbe-4870-8584-baf143e3d918","Type":"ContainerStarted","Data":"ecc04356d537f039d93743e1b6a016145b305c9cab07f01f43bf315065fdf589"} Jul 10 18:59:13.060276 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:13.060241 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7" event={"ID":"a38b7489-9cbe-4870-8584-baf143e3d918","Type":"ContainerStarted","Data":"8b489168ddb136b6b492219f41f5559bbfc6ed1627c9ad287dbd224d551ce4fc"} Jul 10 18:59:13.098082 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:13.098021 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kttl7" podStartSLOduration=3.017340151 podStartE2EDuration="4.098001999s" totalImagesPullingTime="1.080661848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:13.097251614 +0000 UTC m=+72.849429333" watchObservedRunningTime="2026-07-10 18:59:13.098001999 +0000 UTC m=+72.850179720" Jul 10 18:59:13.378225 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:13.378190 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:13.378408 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:13.378285 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:13.378408 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:13.378348 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:59:13.378483 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:13.378411 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls podName:0589b4ec-92dd-4ae5-a06d-196972da25bd nodeName:}" failed. No retries permitted until 2026-07-10 18:59:17.378395647 +0000 UTC m=+77.130573344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdk7n" (UID: "0589b4ec-92dd-4ae5-a06d-196972da25bd") : secret "insights-runtime-extractor-tls" not found Jul 10 18:59:13.378483 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:13.378354 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:59:13.378483 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:13.378444 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm podName:0589b4ec-92dd-4ae5-a06d-196972da25bd nodeName:}" failed. No retries permitted until 2026-07-10 18:59:17.378437976 +0000 UTC m=+77.130615674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdk7n" (UID: "0589b4ec-92dd-4ae5-a06d-196972da25bd") : configmap "kube-rbac-proxy" not found Jul 10 18:59:13.807171 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:13.807085 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xlrhj_76648f19-b078-44a3-b39c-f12b7a772c99/serve-healthcheck-canary/0.log" Jul 10 18:59:14.007311 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:14.007281 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-kttl7_a38b7489-9cbe-4870-8584-baf143e3d918/migrator/0.log" Jul 10 18:59:14.206596 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:14.206565 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-kttl7_a38b7489-9cbe-4870-8584-baf143e3d918/graceful-termination/0.log" Jul 10 18:59:14.408743 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:14.408711 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-p687j_3977581c-775c-498f-ae9a-965374e9d5c4/kube-storage-version-migrator-operator/0.log" Jul 10 18:59:17.417056 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:17.417024 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:17.417492 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:17.417091 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:17.417492 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:17.417153 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:59:17.417492 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:17.417222 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm podName:0589b4ec-92dd-4ae5-a06d-196972da25bd nodeName:}" failed. No retries permitted until 2026-07-10 18:59:25.417206569 +0000 UTC m=+85.169384266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdk7n" (UID: "0589b4ec-92dd-4ae5-a06d-196972da25bd") : configmap "kube-rbac-proxy" not found Jul 10 18:59:17.417492 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:17.417263 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:59:17.417492 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:17.417336 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls podName:0589b4ec-92dd-4ae5-a06d-196972da25bd nodeName:}" failed. No retries permitted until 2026-07-10 18:59:25.417319128 +0000 UTC m=+85.169496850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdk7n" (UID: "0589b4ec-92dd-4ae5-a06d-196972da25bd") : secret "insights-runtime-extractor-tls" not found Jul 10 18:59:20.035343 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:20.035309 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:20.035710 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:20.035426 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:20.035710 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:20.035479 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls podName:cdda9f04-4c6f-4e4f-a8b2-93522e87eea5 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:36.035466113 +0000 UTC m=+95.787643811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-b8s7s" (UID: "cdda9f04-4c6f-4e4f-a8b2-93522e87eea5") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:59:25.474465 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:25.474324 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:25.474465 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:25.474429 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:25.475076 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:25.474459 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:59:25.475076 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:25.474533 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls podName:0589b4ec-92dd-4ae5-a06d-196972da25bd nodeName:}" failed. No retries permitted until 2026-07-10 18:59:41.474514708 +0000 UTC m=+101.226692405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdk7n" (UID: "0589b4ec-92dd-4ae5-a06d-196972da25bd") : secret "insights-runtime-extractor-tls" not found Jul 10 18:59:25.475076 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:25.475005 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0589b4ec-92dd-4ae5-a06d-196972da25bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:36.055790 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:36.055751 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:36.057964 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:36.057944 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdda9f04-4c6f-4e4f-a8b2-93522e87eea5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-b8s7s\" (UID: \"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:36.061920 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:36.061892 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" Jul 10 18:59:36.184565 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:36.184528 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s"] Jul 10 18:59:36.188024 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:36.188000 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdda9f04_4c6f_4e4f_a8b2_93522e87eea5.slice/crio-46add2d0d670d4463c94f35960e871c94dea7cb47574b406d39a433c7fcae869 WatchSource:0}: Error finding container 46add2d0d670d4463c94f35960e871c94dea7cb47574b406d39a433c7fcae869: Status 404 returned error can't find the container with id 46add2d0d670d4463c94f35960e871c94dea7cb47574b406d39a433c7fcae869 Jul 10 18:59:37.136398 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:37.136361 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" event={"ID":"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5","Type":"ContainerStarted","Data":"46add2d0d670d4463c94f35960e871c94dea7cb47574b406d39a433c7fcae869"} Jul 10 18:59:38.938152 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:38.938121 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh"] Jul 10 18:59:38.941373 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:38.941349 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:38.944616 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:38.944581 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 10 18:59:38.944616 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:38.944582 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 10 18:59:38.946061 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:38.946038 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 10 18:59:38.946173 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:38.946043 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 10 18:59:38.958679 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:38.958653 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh"] Jul 10 18:59:39.078749 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.078708 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qms88\" (UniqueName: \"kubernetes.io/projected/9f97944c-b763-4431-9bb3-615cbd6eca0e-kube-api-access-qms88\") pod \"klusterlet-addon-workmgr-8487bfc767-d5xdh\" (UID: \"9f97944c-b763-4431-9bb3-615cbd6eca0e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:39.078749 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.078754 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f97944c-b763-4431-9bb3-615cbd6eca0e-tmp\") pod \"klusterlet-addon-workmgr-8487bfc767-d5xdh\" (UID: \"9f97944c-b763-4431-9bb3-615cbd6eca0e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:39.078969 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.078772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f97944c-b763-4431-9bb3-615cbd6eca0e-klusterlet-config\") pod \"klusterlet-addon-workmgr-8487bfc767-d5xdh\" (UID: \"9f97944c-b763-4431-9bb3-615cbd6eca0e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:39.078969 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.078808 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:59:39.081213 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.081186 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") pod \"image-registry-59c6f66b49-n2dpz\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:59:39.112441 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.112417 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ndwz8\"" Jul 10 18:59:39.117929 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.117903 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:59:39.145156 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.145122 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" event={"ID":"cdda9f04-4c6f-4e4f-a8b2-93522e87eea5","Type":"ContainerStarted","Data":"bee1a6806403f4c8b54d7515ba6df8ba3bd8a044091ad96f73b64e336f0261a1"} Jul 10 18:59:39.172165 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.171561 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-b8s7s" podStartSLOduration=33.172054565 podStartE2EDuration="35.171539469s" totalImagesPullingTime="1.999484904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:39.17026772 +0000 UTC m=+98.922445440" watchObservedRunningTime="2026-07-10 18:59:39.171539469 +0000 UTC m=+98.923717191" Jul 10 18:59:39.180259 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.179458 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qms88\" (UniqueName: \"kubernetes.io/projected/9f97944c-b763-4431-9bb3-615cbd6eca0e-kube-api-access-qms88\") pod \"klusterlet-addon-workmgr-8487bfc767-d5xdh\" (UID: \"9f97944c-b763-4431-9bb3-615cbd6eca0e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:39.180259 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.179510 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f97944c-b763-4431-9bb3-615cbd6eca0e-tmp\") pod \"klusterlet-addon-workmgr-8487bfc767-d5xdh\" (UID: \"9f97944c-b763-4431-9bb3-615cbd6eca0e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:39.180259 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.179537 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f97944c-b763-4431-9bb3-615cbd6eca0e-klusterlet-config\") pod \"klusterlet-addon-workmgr-8487bfc767-d5xdh\" (UID: \"9f97944c-b763-4431-9bb3-615cbd6eca0e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:39.180259 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.179605 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:59:39.181703 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.181003 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f97944c-b763-4431-9bb3-615cbd6eca0e-tmp\") pod \"klusterlet-addon-workmgr-8487bfc767-d5xdh\" (UID: \"9f97944c-b763-4431-9bb3-615cbd6eca0e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:39.187924 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.187871 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f97944c-b763-4431-9bb3-615cbd6eca0e-klusterlet-config\") pod \"klusterlet-addon-workmgr-8487bfc767-d5xdh\" (UID: \"9f97944c-b763-4431-9bb3-615cbd6eca0e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:39.194686 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.194573 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07546b0-c428-47db-9643-3301abd4502d-metrics-tls\") pod \"dns-default-cb9p4\" (UID: \"e07546b0-c428-47db-9643-3301abd4502d\") " pod="openshift-dns/dns-default-cb9p4" Jul 10 18:59:39.203316 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.203264 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qms88\" (UniqueName: \"kubernetes.io/projected/9f97944c-b763-4431-9bb3-615cbd6eca0e-kube-api-access-qms88\") pod \"klusterlet-addon-workmgr-8487bfc767-d5xdh\" (UID: \"9f97944c-b763-4431-9bb3-615cbd6eca0e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:39.251688 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.251654 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:39.261184 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.261162 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c6f66b49-n2dpz"] Jul 10 18:59:39.265378 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:39.265348 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481f3727_cdfd_406c_a24b_c8c11afb093b.slice/crio-4c35ccf5ddfb13905cdee729327dbc51fea7f171b95c3026487290b31e39b7fa WatchSource:0}: Error finding container 4c35ccf5ddfb13905cdee729327dbc51fea7f171b95c3026487290b31e39b7fa: Status 404 returned error can't find the container with id 4c35ccf5ddfb13905cdee729327dbc51fea7f171b95c3026487290b31e39b7fa Jul 10 18:59:39.385449 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.385420 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh"] Jul 10 18:59:39.388474 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:39.388446 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f97944c_b763_4431_9bb3_615cbd6eca0e.slice/crio-bbccf4f91cae04bb1dcd1f7f6b4628101dd863d560aa458fe24bce78d96d0639 WatchSource:0}: Error finding container bbccf4f91cae04bb1dcd1f7f6b4628101dd863d560aa458fe24bce78d96d0639: Status 404 returned error can't find the container with id bbccf4f91cae04bb1dcd1f7f6b4628101dd863d560aa458fe24bce78d96d0639 Jul 10 18:59:39.431095 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.431070 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-99kdr\"" Jul 10 18:59:39.439345 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.439327 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cb9p4" Jul 10 18:59:39.568098 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:39.564787 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cb9p4"] Jul 10 18:59:40.149389 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:40.149346 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" event={"ID":"9f97944c-b763-4431-9bb3-615cbd6eca0e","Type":"ContainerStarted","Data":"bbccf4f91cae04bb1dcd1f7f6b4628101dd863d560aa458fe24bce78d96d0639"} Jul 10 18:59:40.150587 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:40.150550 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cb9p4" event={"ID":"e07546b0-c428-47db-9643-3301abd4502d","Type":"ContainerStarted","Data":"138f35ac6b2cc2fac0fd61004bf5d4ea341e6d1911fdbeeb9c0e16589bb326b5"} Jul 10 18:59:40.152064 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:40.152026 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" event={"ID":"481f3727-cdfd-406c-a24b-c8c11afb093b","Type":"ContainerStarted","Data":"0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2"} Jul 10 18:59:40.152204 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:40.152087 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" event={"ID":"481f3727-cdfd-406c-a24b-c8c11afb093b","Type":"ContainerStarted","Data":"4c35ccf5ddfb13905cdee729327dbc51fea7f171b95c3026487290b31e39b7fa"} Jul 10 18:59:40.180653 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:40.180602 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" podStartSLOduration=99.180583394 podStartE2EDuration="1m39.180583394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:40.179611801 +0000 UTC m=+99.931789520" watchObservedRunningTime="2026-07-10 18:59:40.180583394 +0000 UTC m=+99.932761115" Jul 10 18:59:41.159579 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:41.159532 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 18:59:41.502047 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:41.501964 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:41.504674 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:41.504650 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0589b4ec-92dd-4ae5-a06d-196972da25bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdk7n\" (UID: \"0589b4ec-92dd-4ae5-a06d-196972da25bd\") " pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:41.733936 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:41.733900 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jdk7n" Jul 10 18:59:42.337542 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:42.337513 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jdk7n"] Jul 10 18:59:43.063177 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:43.063147 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dsprs" Jul 10 18:59:43.167436 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:43.167398 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdk7n" event={"ID":"0589b4ec-92dd-4ae5-a06d-196972da25bd","Type":"ContainerStarted","Data":"fc70962cee98ddf5b90d2f20b335c0e6537d8a6adbc5d22b26f54cb63483a536"} Jul 10 18:59:43.168969 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:43.168946 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cb9p4" event={"ID":"e07546b0-c428-47db-9643-3301abd4502d","Type":"ContainerStarted","Data":"9e8f8856fad6d78cbd2b23f9ad0448ba8e34b67d5f89c69db66a50b6d71a6850"} Jul 10 18:59:44.176110 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:44.176059 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cb9p4" event={"ID":"e07546b0-c428-47db-9643-3301abd4502d","Type":"ContainerStarted","Data":"3ab3845c72bf67e3bb0814a46d535ebfdae36c71d3d3add5abd909aeca09eb02"} Jul 10 18:59:44.176561 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:44.176525 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cb9p4" Jul 10 18:59:44.178494 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:44.178466 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" event={"ID":"9f97944c-b763-4431-9bb3-615cbd6eca0e","Type":"ContainerStarted","Data":"c1c77335d81e35e674ecaf4f8453c1fd185f246000ba95279eaf51f70b47f6ce"} Jul 10 18:59:44.178938 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:44.178921 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:44.180443 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:44.180425 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" Jul 10 18:59:44.197879 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:44.197828 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cb9p4" podStartSLOduration=66.506706764 podStartE2EDuration="1m9.197808747s" totalImagesPullingTime="2.691101983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:44.19603843 +0000 UTC m=+103.948216151" watchObservedRunningTime="2026-07-10 18:59:44.197808747 +0000 UTC m=+103.949986468" Jul 10 18:59:44.215848 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:44.215771 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8487bfc767-d5xdh" podStartSLOduration=1.6403629419999999 podStartE2EDuration="6.215746764s" totalImagesPullingTime="4.575383822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:44.215360854 +0000 UTC m=+103.967538596" watchObservedRunningTime="2026-07-10 18:59:44.215746764 +0000 UTC m=+103.967924483" Jul 10 18:59:48.194291 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.194204 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdk7n" event={"ID":"0589b4ec-92dd-4ae5-a06d-196972da25bd","Type":"ContainerStarted","Data":"75771adb58fbcc61fe06f8f595d85499bee0a8b1663e2738eb079ac48e3814db"} Jul 10 18:59:48.611966 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.611947 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-794c6c698d-rnszc"] Jul 10 18:59:48.613912 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.613895 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.617668 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.617649 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 18:59:48.618821 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.618760 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 18:59:48.618821 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.618768 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 18:59:48.618821 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.618794 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 18:59:48.619082 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.618867 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d6shc\"" Jul 10 18:59:48.619082 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.619077 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 18:59:48.619346 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.619326 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 18:59:48.619454 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.619438 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 18:59:48.641050 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.641033 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794c6c698d-rnszc"] Jul 10 18:59:48.656492 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.656469 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-serving-cert\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.656585 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.656497 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-oauth-serving-cert\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.656585 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.656517 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-service-ca\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.656585 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.656537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25rlg\" (UniqueName: \"kubernetes.io/projected/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-kube-api-access-25rlg\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.656701 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.656627 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-config\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.656701 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.656657 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-oauth-config\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.757142 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.757087 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-serving-cert\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.757142 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.757115 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-oauth-serving-cert\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.757142 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.757142 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-service-ca\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.757378 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.757166 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25rlg\" (UniqueName: \"kubernetes.io/projected/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-kube-api-access-25rlg\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.757378 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.757332 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-config\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.757378 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.757372 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-oauth-config\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.757857 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.757835 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-oauth-serving-cert\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.757929 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.757876 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-service-ca\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.757929 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.757913 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-config\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.759474 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.759456 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-oauth-config\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.759551 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.759533 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-serving-cert\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.766131 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.766114 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25rlg\" (UniqueName: \"kubernetes.io/projected/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-kube-api-access-25rlg\") pod \"console-794c6c698d-rnszc\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:48.922587 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:48.922565 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:49.061029 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.060957 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794c6c698d-rnszc"] Jul 10 18:59:49.064477 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:49.064441 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e5bbe6_9196_43e5_b11b_b3dfe1bb2bca.slice/crio-b9c194e0d47a02f828da10673b7551b6cf7602008626434331ac655651b850f9 WatchSource:0}: Error finding container b9c194e0d47a02f828da10673b7551b6cf7602008626434331ac655651b850f9: Status 404 returned error can't find the container with id b9c194e0d47a02f828da10673b7551b6cf7602008626434331ac655651b850f9 Jul 10 18:59:49.200841 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.200800 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdk7n" event={"ID":"0589b4ec-92dd-4ae5-a06d-196972da25bd","Type":"ContainerStarted","Data":"bf642a8ca9bcfb7464fefac6b828a4bbc572511bf9fadb4a9958e5f5f9076c72"} Jul 10 18:59:49.202166 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.202135 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794c6c698d-rnszc" event={"ID":"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca","Type":"ContainerStarted","Data":"b9c194e0d47a02f828da10673b7551b6cf7602008626434331ac655651b850f9"} Jul 10 18:59:49.589866 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.589837 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr"] Jul 10 18:59:49.592318 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.592298 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.596399 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.596376 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9vffd\"" Jul 10 18:59:49.596399 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.596388 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 10 18:59:49.597888 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.597863 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 18:59:49.597988 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.597904 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 10 18:59:49.616387 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.616363 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr"] Jul 10 18:59:49.653813 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.653789 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r2bxm"] Jul 10 18:59:49.656396 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.656374 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.659711 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.659664 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 18:59:49.660622 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.660452 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 18:59:49.660622 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.660485 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 18:59:49.660786 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.660701 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j22gr\"" Jul 10 18:59:49.663426 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663400 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-textfile\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.663523 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663436 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkwvp\" (UniqueName: \"kubernetes.io/projected/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-kube-api-access-nkwvp\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.663523 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663481 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ca0c6f0-d933-4cce-bfed-c37532bca879-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.663523 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663515 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-metrics-client-ca\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.663691 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.663691 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663572 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls2j8\" (UniqueName: \"kubernetes.io/projected/5ca0c6f0-d933-4cce-bfed-c37532bca879-kube-api-access-ls2j8\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.663691 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663600 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-tls\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.663691 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663629 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ca0c6f0-d933-4cce-bfed-c37532bca879-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.663691 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ca0c6f0-d933-4cce-bfed-c37532bca879-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.663934 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663691 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-root\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.663934 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663724 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-sys\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.663934 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663797 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-wtmp\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.663934 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.663826 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.764811 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.764778 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-textfile\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.764979 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.764825 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkwvp\" (UniqueName: \"kubernetes.io/projected/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-kube-api-access-nkwvp\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.764979 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.764877 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ca0c6f0-d933-4cce-bfed-c37532bca879-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.764979 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.764909 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-metrics-client-ca\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.764979 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.764934 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.764979 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.764968 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls2j8\" (UniqueName: \"kubernetes.io/projected/5ca0c6f0-d933-4cce-bfed-c37532bca879-kube-api-access-ls2j8\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.765497 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.764996 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-tls\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.765497 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.765133 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ca0c6f0-d933-4cce-bfed-c37532bca879-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.765497 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.765183 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ca0c6f0-d933-4cce-bfed-c37532bca879-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.765497 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.765209 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-root\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.765497 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.765254 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-sys\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.765497 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.765281 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-wtmp\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.765497 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.765304 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.767212 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.765995 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-root\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.767212 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.766558 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-wtmp\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.767212 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.766733 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-textfile\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.767212 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.766869 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-sys\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.767212 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.766873 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ca0c6f0-d933-4cce-bfed-c37532bca879-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.767212 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.767149 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-metrics-client-ca\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.767671 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.767649 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.769141 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.769117 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ca0c6f0-d933-4cce-bfed-c37532bca879-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.784272 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.769676 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.784272 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.770372 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ca0c6f0-d933-4cce-bfed-c37532bca879-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.787981 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.787945 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-node-exporter-tls\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.788454 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.788432 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls2j8\" (UniqueName: \"kubernetes.io/projected/5ca0c6f0-d933-4cce-bfed-c37532bca879-kube-api-access-ls2j8\") pod \"openshift-state-metrics-84bd68b896-fhlrr\" (UID: \"5ca0c6f0-d933-4cce-bfed-c37532bca879\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.789578 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.789560 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkwvp\" (UniqueName: \"kubernetes.io/projected/b75244c7-75f8-4ce6-8fb9-1a326e9449b8-kube-api-access-nkwvp\") pod \"node-exporter-r2bxm\" (UID: \"b75244c7-75f8-4ce6-8fb9-1a326e9449b8\") " pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.903782 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.903707 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" Jul 10 18:59:49.967283 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:49.967183 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r2bxm" Jul 10 18:59:49.980643 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:49.980606 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75244c7_75f8_4ce6_8fb9_1a326e9449b8.slice/crio-b806655936271acee170c5c7017715d38392a8a3147e8f2f246cf426f0242e09 WatchSource:0}: Error finding container b806655936271acee170c5c7017715d38392a8a3147e8f2f246cf426f0242e09: Status 404 returned error can't find the container with id b806655936271acee170c5c7017715d38392a8a3147e8f2f246cf426f0242e09 Jul 10 18:59:50.076916 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.076872 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr"] Jul 10 18:59:50.209144 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.208515 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2bxm" event={"ID":"b75244c7-75f8-4ce6-8fb9-1a326e9449b8","Type":"ContainerStarted","Data":"b806655936271acee170c5c7017715d38392a8a3147e8f2f246cf426f0242e09"} Jul 10 18:59:50.456847 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.456815 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:59:50.462526 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.462455 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.468057 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.467994 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 18:59:50.468343 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.468315 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 18:59:50.468458 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.468406 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 18:59:50.469646 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.469623 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 18:59:50.470593 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.470570 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 18:59:50.471300 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.471281 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 18:59:50.472839 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.472098 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 18:59:50.472839 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.472517 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bfzbb\"" Jul 10 18:59:50.472997 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.472978 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 18:59:50.473394 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.473376 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 18:59:50.485688 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.485666 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:59:50.573811 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.573773 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.573975 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.573835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.573975 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.573864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.573975 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.573898 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.573975 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.573933 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-config-out\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.573975 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.573955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.574227 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.573985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.574227 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.574014 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.574227 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.574064 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.574227 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.574116 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjl2b\" (UniqueName: \"kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-kube-api-access-rjl2b\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.574227 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.574161 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.574487 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.574249 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.574487 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.574286 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-web-config\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675264 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675215 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675413 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675283 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-web-config\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675413 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675333 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675413 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675372 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675413 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675394 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675680 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675426 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675680 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675460 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-config-out\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675680 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675484 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675680 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675512 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675680 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675541 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675680 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675567 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.675680 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675594 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjl2b\" (UniqueName: \"kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-kube-api-access-rjl2b\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.677024 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.675606 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.677024 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:50.676197 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-trusted-ca-bundle podName:e8642d1b-4e05-463f-b162-b8294e819f8c nodeName:}" failed. No retries permitted until 2026-07-10 18:59:51.176176014 +0000 UTC m=+110.928353711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c") : configmap references non-existent config key: ca-bundle.crt Jul 10 18:59:50.677024 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:50.676467 2555 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 10 18:59:50.677024 ip-10-0-134-251 kubenswrapper[2555]: E0710 18:59:50.676742 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-main-tls podName:e8642d1b-4e05-463f-b162-b8294e819f8c nodeName:}" failed. No retries permitted until 2026-07-10 18:59:51.176725261 +0000 UTC m=+110.928902959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c") : secret "alertmanager-main-tls" not found Jul 10 18:59:50.677024 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.676761 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.677376 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.677057 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.678371 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.678345 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-web-config\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.682712 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.682645 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.683174 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.683139 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.683309 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.683223 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.683885 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.683586 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.683885 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.683866 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-config-out\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.684011 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.683867 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.684814 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.684773 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:50.694815 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:50.694745 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjl2b\" (UniqueName: \"kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-kube-api-access-rjl2b\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:51.181504 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:51.181465 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:51.181694 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:51.181514 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:51.182206 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:51.182176 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:51.183984 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:51.183952 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:51.203015 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:51.202983 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca0c6f0_d933_4cce_bfed_c37532bca879.slice/crio-4626de1f47477facdbd1b0aca6ca01f2de7ff4d8574d3e0513f688efada680a7 WatchSource:0}: Error finding container 4626de1f47477facdbd1b0aca6ca01f2de7ff4d8574d3e0513f688efada680a7: Status 404 returned error can't find the container with id 4626de1f47477facdbd1b0aca6ca01f2de7ff4d8574d3e0513f688efada680a7 Jul 10 18:59:51.213338 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:51.213305 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" event={"ID":"5ca0c6f0-d933-4cce-bfed-c37532bca879","Type":"ContainerStarted","Data":"4626de1f47477facdbd1b0aca6ca01f2de7ff4d8574d3e0513f688efada680a7"} Jul 10 18:59:51.380496 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:51.380467 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:59:52.666868 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:52.666844 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:59:52.668436 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:52.668411 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8642d1b_4e05_463f_b162_b8294e819f8c.slice/crio-2c9482d111f4c15ab5eadf5e4e1f444a2143123f34beb44d9e94cc3eb04e87d4 WatchSource:0}: Error finding container 2c9482d111f4c15ab5eadf5e4e1f444a2143123f34beb44d9e94cc3eb04e87d4: Status 404 returned error can't find the container with id 2c9482d111f4c15ab5eadf5e4e1f444a2143123f34beb44d9e94cc3eb04e87d4 Jul 10 18:59:53.226381 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:53.226345 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdk7n" event={"ID":"0589b4ec-92dd-4ae5-a06d-196972da25bd","Type":"ContainerStarted","Data":"7826307e8a5fd68f780b6d01dac6ca12ade08e3163837cb257f78c3e256b79a8"} Jul 10 18:59:53.227859 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:53.227831 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794c6c698d-rnszc" event={"ID":"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca","Type":"ContainerStarted","Data":"dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64"} Jul 10 18:59:53.229441 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:53.229411 2555 generic.go:356] "Generic (PLEG): container finished" podID="b75244c7-75f8-4ce6-8fb9-1a326e9449b8" containerID="b305488aa6bf3f950467a77c35f1a7eca0f60fbb9e869d171e9724e6b31dfd33" exitCode=0 Jul 10 18:59:53.229563 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:53.229535 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2bxm" event={"ID":"b75244c7-75f8-4ce6-8fb9-1a326e9449b8","Type":"ContainerDied","Data":"b305488aa6bf3f950467a77c35f1a7eca0f60fbb9e869d171e9724e6b31dfd33"} Jul 10 18:59:53.231556 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:53.231532 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" event={"ID":"5ca0c6f0-d933-4cce-bfed-c37532bca879","Type":"ContainerStarted","Data":"c7c05d05e36c66afa41e7d04bb196116432faa58e2bc54e25ad5ccb8c8e4b609"} Jul 10 18:59:53.231658 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:53.231573 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" event={"ID":"5ca0c6f0-d933-4cce-bfed-c37532bca879","Type":"ContainerStarted","Data":"dea83f540b8b151af31a88eb3cc845fe7a29f7eb89cd5057afd0ce81fbe9fe26"} Jul 10 18:59:53.232678 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:53.232653 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerStarted","Data":"2c9482d111f4c15ab5eadf5e4e1f444a2143123f34beb44d9e94cc3eb04e87d4"} Jul 10 18:59:53.254382 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:53.254337 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jdk7n" podStartSLOduration=34.264808311 podStartE2EDuration="44.254301785s" totalImagesPullingTime="9.989493474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:59:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:53.254024277 +0000 UTC m=+113.006201996" watchObservedRunningTime="2026-07-10 18:59:53.254301785 +0000 UTC m=+113.006479519" Jul 10 18:59:53.343527 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:53.343477 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-794c6c698d-rnszc" podStartSLOduration=1.9182313579999999 podStartE2EDuration="5.343455602s" totalImagesPullingTime="3.425224244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:53.342341934 +0000 UTC m=+113.094519652" watchObservedRunningTime="2026-07-10 18:59:53.343455602 +0000 UTC m=+113.095633322" Jul 10 18:59:54.184349 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.184278 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cb9p4" Jul 10 18:59:54.215339 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.215310 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6cf75c4448-97vwj"] Jul 10 18:59:54.217805 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.217791 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.225773 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.225755 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 10 18:59:54.230489 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.230467 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7cb8k8h4nllf0\"" Jul 10 18:59:54.230591 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.230497 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-72dj7\"" Jul 10 18:59:54.230591 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.230471 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 10 18:59:54.230591 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.230471 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 18:59:54.230779 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.230767 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 10 18:59:54.238139 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.238118 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" event={"ID":"5ca0c6f0-d933-4cce-bfed-c37532bca879","Type":"ContainerStarted","Data":"a372902401dfcda2b7b7a83dd8d4d1355addeca45ea5265f7abf4a16ab17e25c"} Jul 10 18:59:54.239599 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.239576 2555 generic.go:356] "Generic (PLEG): container finished" podID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerID="82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773" exitCode=0 Jul 10 18:59:54.239670 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.239657 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerDied","Data":"82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773"} Jul 10 18:59:54.241622 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.241603 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2bxm" event={"ID":"b75244c7-75f8-4ce6-8fb9-1a326e9449b8","Type":"ContainerStarted","Data":"9aebc43adcb5779d599bb5df66d36e9237a83b405628d8fef9e582a68f29e2ae"} Jul 10 18:59:54.241728 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.241639 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2bxm" event={"ID":"b75244c7-75f8-4ce6-8fb9-1a326e9449b8","Type":"ContainerStarted","Data":"38b7cc0dfb0c40101233c9e1c341271149f947253b7b3679b2e3936b74c97023"} Jul 10 18:59:54.252472 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.252450 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cf75c4448-97vwj"] Jul 10 18:59:54.308045 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.308011 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjk7l\" (UniqueName: \"kubernetes.io/projected/44b9d14a-35e4-43d9-ab8e-aee7699826f1-kube-api-access-gjk7l\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.308298 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.308210 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b9d14a-35e4-43d9-ab8e-aee7699826f1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.308402 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.308353 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/44b9d14a-35e4-43d9-ab8e-aee7699826f1-audit-log\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.308639 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.308615 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44b9d14a-35e4-43d9-ab8e-aee7699826f1-client-ca-bundle\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.308802 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.308782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/44b9d14a-35e4-43d9-ab8e-aee7699826f1-secret-metrics-server-tls\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.308917 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.308898 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/44b9d14a-35e4-43d9-ab8e-aee7699826f1-metrics-server-audit-profiles\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.309028 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.309003 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/44b9d14a-35e4-43d9-ab8e-aee7699826f1-secret-metrics-server-client-certs\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.347892 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.347854 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r2bxm" podStartSLOduration=2.761790605 podStartE2EDuration="5.34784195s" totalImagesPullingTime="2.513031605s" totalInitContainerRuntime="73.01974ms" isStatefulPod=true podCreationTimestamp="2026-07-10 18:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:54.347165091 +0000 UTC m=+114.099342810" watchObservedRunningTime="2026-07-10 18:59:54.34784195 +0000 UTC m=+114.100019668" Jul 10 18:59:54.348421 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.348396 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fhlrr" podStartSLOduration=4.15167868 podStartE2EDuration="5.348390639s" totalImagesPullingTime="1.196711959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:54.318066915 +0000 UTC m=+114.070244633" watchObservedRunningTime="2026-07-10 18:59:54.348390639 +0000 UTC m=+114.100568357" Jul 10 18:59:54.410173 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.410154 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/44b9d14a-35e4-43d9-ab8e-aee7699826f1-metrics-server-audit-profiles\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.410304 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.410185 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/44b9d14a-35e4-43d9-ab8e-aee7699826f1-secret-metrics-server-client-certs\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.410304 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.410220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjk7l\" (UniqueName: \"kubernetes.io/projected/44b9d14a-35e4-43d9-ab8e-aee7699826f1-kube-api-access-gjk7l\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.410304 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.410262 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b9d14a-35e4-43d9-ab8e-aee7699826f1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.410304 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.410280 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/44b9d14a-35e4-43d9-ab8e-aee7699826f1-audit-log\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.410304 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.410297 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44b9d14a-35e4-43d9-ab8e-aee7699826f1-client-ca-bundle\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.410530 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.410312 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/44b9d14a-35e4-43d9-ab8e-aee7699826f1-secret-metrics-server-tls\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.410765 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.410731 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/44b9d14a-35e4-43d9-ab8e-aee7699826f1-audit-log\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.411226 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.411205 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b9d14a-35e4-43d9-ab8e-aee7699826f1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.411359 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.411336 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/44b9d14a-35e4-43d9-ab8e-aee7699826f1-metrics-server-audit-profiles\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.412874 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.412846 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44b9d14a-35e4-43d9-ab8e-aee7699826f1-client-ca-bundle\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.412971 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.412945 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/44b9d14a-35e4-43d9-ab8e-aee7699826f1-secret-metrics-server-tls\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.413274 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.413255 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/44b9d14a-35e4-43d9-ab8e-aee7699826f1-secret-metrics-server-client-certs\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.435323 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.435278 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjk7l\" (UniqueName: \"kubernetes.io/projected/44b9d14a-35e4-43d9-ab8e-aee7699826f1-kube-api-access-gjk7l\") pod \"metrics-server-6cf75c4448-97vwj\" (UID: \"44b9d14a-35e4-43d9-ab8e-aee7699826f1\") " pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.526034 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.526012 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 18:59:54.662861 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:54.662835 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cf75c4448-97vwj"] Jul 10 18:59:54.665746 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:54.665717 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b9d14a_35e4_43d9_ab8e_aee7699826f1.slice/crio-200015238dd16d89e807076bf2bac53abf78569e00aaa84ea22da8d0166efcbb WatchSource:0}: Error finding container 200015238dd16d89e807076bf2bac53abf78569e00aaa84ea22da8d0166efcbb: Status 404 returned error can't find the container with id 200015238dd16d89e807076bf2bac53abf78569e00aaa84ea22da8d0166efcbb Jul 10 18:59:55.247437 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.247390 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" event={"ID":"44b9d14a-35e4-43d9-ab8e-aee7699826f1","Type":"ContainerStarted","Data":"200015238dd16d89e807076bf2bac53abf78569e00aaa84ea22da8d0166efcbb"} Jul 10 18:59:55.909426 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.909395 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:59:55.912072 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.912055 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.916800 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.916778 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 18:59:55.918765 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.918747 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 18:59:55.918831 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.918777 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 18:59:55.918950 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.918929 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 18:59:55.918950 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.918946 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 18:59:55.919083 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.918967 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-85grh\"" Jul 10 18:59:55.919083 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.919013 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 18:59:55.919083 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.918950 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 18:59:55.919083 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.919082 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 18:59:55.919273 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.919097 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 18:59:55.919564 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.919548 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 18:59:55.920078 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.920061 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 18:59:55.920205 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.920188 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-frk50q8vn0eh9\"" Jul 10 18:59:55.920461 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.920446 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 18:59:55.922711 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.922693 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 18:59:55.923045 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923018 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923118 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923059 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config-out\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923118 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923087 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923200 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923121 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923200 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923307 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923307 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923284 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjpfh\" (UniqueName: \"kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-kube-api-access-rjpfh\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923307 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923304 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923435 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923319 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923435 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923335 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923435 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923388 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923435 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923420 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-web-config\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923608 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923446 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923608 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923476 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923608 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923507 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923608 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923535 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923608 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923608 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923595 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923809 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923619 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.923809 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.923635 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:55.928665 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.928648 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 18:59:55.967938 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:55.967914 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:59:56.024297 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024271 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024437 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024311 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjpfh\" (UniqueName: \"kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-kube-api-access-rjpfh\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024437 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024437 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024372 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024437 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024397 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024437 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024423 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024665 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024441 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-web-config\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024665 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024460 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024665 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024480 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024665 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024502 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024665 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024528 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024665 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024547 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024665 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024562 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.024665 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024587 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.025010 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024877 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.025010 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.024955 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.025010 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.025002 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config-out\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.025142 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.025029 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.025142 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.025052 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.025142 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.025078 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.027344 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.025655 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.027344 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.026147 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.027344 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.026739 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.027915 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.027618 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.027915 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.027724 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.027915 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.027756 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.027915 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.027797 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.028169 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.028028 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.028247 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.028181 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.028431 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.028408 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.028767 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.028644 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.028767 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.028664 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.029089 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.029070 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.030019 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.029977 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.030398 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.030380 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.030469 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.030400 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config-out\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.030875 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.030853 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.031172 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.031150 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-web-config\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.031332 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.031311 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.048522 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.048504 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjpfh\" (UniqueName: \"kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-kube-api-access-rjpfh\") pod \"prometheus-k8s-0\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.222377 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.222295 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:59:56.260661 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.260622 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerStarted","Data":"60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f"} Jul 10 18:59:56.260998 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.260722 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerStarted","Data":"9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038"} Jul 10 18:59:56.260998 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.260751 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerStarted","Data":"0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928"} Jul 10 18:59:56.260998 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.260791 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerStarted","Data":"2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde"} Jul 10 18:59:56.260998 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.260829 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerStarted","Data":"4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b"} Jul 10 18:59:56.589438 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:56.589412 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:59:56.591651 ip-10-0-134-251 kubenswrapper[2555]: W0710 18:59:56.591624 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bdf8fc4_3605_4a45_92a3_5afc12ae7023.slice/crio-9b2da0ce56577ddb48933e21fd5ae80d47d00d9fa592707dd38a34781662fe22 WatchSource:0}: Error finding container 9b2da0ce56577ddb48933e21fd5ae80d47d00d9fa592707dd38a34781662fe22: Status 404 returned error can't find the container with id 9b2da0ce56577ddb48933e21fd5ae80d47d00d9fa592707dd38a34781662fe22 Jul 10 18:59:57.265145 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:57.265063 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" event={"ID":"44b9d14a-35e4-43d9-ab8e-aee7699826f1","Type":"ContainerStarted","Data":"7bed70feda5fdbdfee7f08ce42a9eac589163cb10bc258f3fa222fd53aabcfab"} Jul 10 18:59:57.266438 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:57.266416 2555 generic.go:356] "Generic (PLEG): container finished" podID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerID="9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0" exitCode=0 Jul 10 18:59:57.266517 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:57.266499 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerDied","Data":"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0"} Jul 10 18:59:57.266581 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:57.266569 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerStarted","Data":"9b2da0ce56577ddb48933e21fd5ae80d47d00d9fa592707dd38a34781662fe22"} Jul 10 18:59:57.269904 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:57.269878 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerStarted","Data":"8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1"} Jul 10 18:59:57.286065 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:57.286027 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" podStartSLOduration=1.512289683 podStartE2EDuration="3.286014392s" totalImagesPullingTime="1.773724709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:57.285145141 +0000 UTC m=+117.037322862" watchObservedRunningTime="2026-07-10 18:59:57.286014392 +0000 UTC m=+117.038192110" Jul 10 18:59:57.353241 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:57.353194 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.830771563 podStartE2EDuration="7.353177917s" totalImagesPullingTime="3.504960577s" totalInitContainerRuntime="17.445777ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:57.35230432 +0000 UTC m=+117.104482038" watchObservedRunningTime="2026-07-10 18:59:57.353177917 +0000 UTC m=+117.105355636" Jul 10 18:59:58.923393 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:58.923361 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:58.923817 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:58.923433 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:58.929056 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:58.929031 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-794c6c698d-rnszc" Jul 10 18:59:59.283589 ip-10-0-134-251 kubenswrapper[2555]: I0710 18:59:59.283515 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-794c6c698d-rnszc" Jul 10 19:00:01.289536 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:01.289501 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerStarted","Data":"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f"} Jul 10 19:00:01.289903 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:01.289578 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerStarted","Data":"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5"} Jul 10 19:00:01.539951 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:01.539876 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59c6f66b49-n2dpz"] Jul 10 19:00:01.545129 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:01.545103 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 19:00:03.301618 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:03.301531 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerStarted","Data":"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83"} Jul 10 19:00:03.301618 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:03.301605 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerStarted","Data":"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a"} Jul 10 19:00:03.301991 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:03.301638 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerStarted","Data":"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61"} Jul 10 19:00:03.301991 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:03.301663 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerStarted","Data":"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0"} Jul 10 19:00:06.222595 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:06.222563 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:00:09.547143 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:09.547109 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 19:00:09.549352 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:09.549334 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9668ee03-c888-4b72-96a5-f35850c46e12-metrics-certs\") pod \"network-metrics-daemon-4z4gc\" (UID: \"9668ee03-c888-4b72-96a5-f35850c46e12\") " pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 19:00:09.632170 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:09.632144 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xvd26\"" Jul 10 19:00:09.636695 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:09.636677 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z4gc" Jul 10 19:00:09.681527 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:09.681477 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.396602688 podStartE2EDuration="14.681457717s" totalImagesPullingTime="5.264575114s" totalInitContainerRuntime="20.279915ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:03.336518715 +0000 UTC m=+123.088696444" watchObservedRunningTime="2026-07-10 19:00:09.681457717 +0000 UTC m=+129.433635437" Jul 10 19:00:09.681732 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:09.681717 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794c6c698d-rnszc"] Jul 10 19:00:09.770011 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:09.769987 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4z4gc"] Jul 10 19:00:09.772269 ip-10-0-134-251 kubenswrapper[2555]: W0710 19:00:09.772210 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9668ee03_c888_4b72_96a5_f35850c46e12.slice/crio-daf5cefc77742f50344600f9ef941524e63767d603f9a08fdd04296bcad506e6 WatchSource:0}: Error finding container daf5cefc77742f50344600f9ef941524e63767d603f9a08fdd04296bcad506e6: Status 404 returned error can't find the container with id daf5cefc77742f50344600f9ef941524e63767d603f9a08fdd04296bcad506e6 Jul 10 19:00:10.328884 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:10.328847 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4z4gc" event={"ID":"9668ee03-c888-4b72-96a5-f35850c46e12","Type":"ContainerStarted","Data":"daf5cefc77742f50344600f9ef941524e63767d603f9a08fdd04296bcad506e6"} Jul 10 19:00:11.333726 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:11.333685 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4z4gc" event={"ID":"9668ee03-c888-4b72-96a5-f35850c46e12","Type":"ContainerStarted","Data":"ea05b8e9a4ebbaab1c1b14ff8e74bb354ec96fd661f1140e417fd88f269ebcd9"} Jul 10 19:00:11.334083 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:11.333772 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4z4gc" event={"ID":"9668ee03-c888-4b72-96a5-f35850c46e12","Type":"ContainerStarted","Data":"aecdd8f1e50cee22af43161d1c8e2ad543865de66987e27dceb470741afc565b"} Jul 10 19:00:13.343011 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:13.342981 2555 generic.go:356] "Generic (PLEG): container finished" podID="3977581c-775c-498f-ae9a-965374e9d5c4" containerID="46e6684097536bd9af089196d24ebc457bad8ab0626ea2a1bae568edc4567eb9" exitCode=0 Jul 10 19:00:13.343357 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:13.343049 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" event={"ID":"3977581c-775c-498f-ae9a-965374e9d5c4","Type":"ContainerDied","Data":"46e6684097536bd9af089196d24ebc457bad8ab0626ea2a1bae568edc4567eb9"} Jul 10 19:00:13.343357 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:13.343353 2555 scope.go:117] "RemoveContainer" containerID="46e6684097536bd9af089196d24ebc457bad8ab0626ea2a1bae568edc4567eb9" Jul 10 19:00:13.366481 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:13.366440 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4z4gc" podStartSLOduration=131.34603315 podStartE2EDuration="2m12.366427211s" totalImagesPullingTime="1.020394061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:11.358842497 +0000 UTC m=+131.111020217" watchObservedRunningTime="2026-07-10 19:00:13.366427211 +0000 UTC m=+133.118604930" Jul 10 19:00:14.349252 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:14.349201 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-p687j" event={"ID":"3977581c-775c-498f-ae9a-965374e9d5c4","Type":"ContainerStarted","Data":"6e387b7bd7380a6f527a1b178080e097dff2a93d8cc57f47d6241bf08edc594c"} Jul 10 19:00:14.526294 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:14.526254 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 19:00:14.526474 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:14.526308 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 19:00:15.627451 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:15.627417 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xlrhj_76648f19-b078-44a3-b39c-f12b7a772c99/serve-healthcheck-canary/0.log" Jul 10 19:00:26.563433 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.563388 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" podUID="481f3727-cdfd-406c-a24b-c8c11afb093b" containerName="registry" containerID="cri-o://0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2" gracePeriod=30 Jul 10 19:00:26.848890 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.848856 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 19:00:26.989766 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.989733 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-trusted-ca\") pod \"481f3727-cdfd-406c-a24b-c8c11afb093b\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " Jul 10 19:00:26.989941 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.989783 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtx2p\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-kube-api-access-xtx2p\") pod \"481f3727-cdfd-406c-a24b-c8c11afb093b\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " Jul 10 19:00:26.989941 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.989822 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") pod \"481f3727-cdfd-406c-a24b-c8c11afb093b\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " Jul 10 19:00:26.989941 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.989843 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/481f3727-cdfd-406c-a24b-c8c11afb093b-ca-trust-extracted\") pod \"481f3727-cdfd-406c-a24b-c8c11afb093b\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " Jul 10 19:00:26.989941 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.989882 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-image-registry-private-configuration\") pod \"481f3727-cdfd-406c-a24b-c8c11afb093b\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " Jul 10 19:00:26.990143 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.990063 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-certificates\") pod \"481f3727-cdfd-406c-a24b-c8c11afb093b\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " Jul 10 19:00:26.990143 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.990109 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-installation-pull-secrets\") pod \"481f3727-cdfd-406c-a24b-c8c11afb093b\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " Jul 10 19:00:26.990270 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.990144 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-bound-sa-token\") pod \"481f3727-cdfd-406c-a24b-c8c11afb093b\" (UID: \"481f3727-cdfd-406c-a24b-c8c11afb093b\") " Jul 10 19:00:26.990444 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.990410 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "481f3727-cdfd-406c-a24b-c8c11afb093b" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:00:26.990552 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.990504 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-certificates\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:26.991154 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.991129 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "481f3727-cdfd-406c-a24b-c8c11afb093b" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:00:26.992520 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.992470 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "481f3727-cdfd-406c-a24b-c8c11afb093b" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:00:26.992632 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.992525 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-kube-api-access-xtx2p" (OuterVolumeSpecName: "kube-api-access-xtx2p") pod "481f3727-cdfd-406c-a24b-c8c11afb093b" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b"). InnerVolumeSpecName "kube-api-access-xtx2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:00:26.992632 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.992596 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "481f3727-cdfd-406c-a24b-c8c11afb093b" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:00:26.992807 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.992784 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "481f3727-cdfd-406c-a24b-c8c11afb093b" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:00:26.994065 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:26.993992 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "481f3727-cdfd-406c-a24b-c8c11afb093b" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:00:27.000182 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.000156 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/481f3727-cdfd-406c-a24b-c8c11afb093b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "481f3727-cdfd-406c-a24b-c8c11afb093b" (UID: "481f3727-cdfd-406c-a24b-c8c11afb093b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:00:27.091060 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.091028 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-image-registry-private-configuration\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:27.091060 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.091058 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/481f3727-cdfd-406c-a24b-c8c11afb093b-installation-pull-secrets\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:27.091060 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.091069 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-bound-sa-token\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:27.091306 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.091077 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/481f3727-cdfd-406c-a24b-c8c11afb093b-trusted-ca\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:27.091306 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.091086 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtx2p\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-kube-api-access-xtx2p\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:27.091306 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.091094 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/481f3727-cdfd-406c-a24b-c8c11afb093b-registry-tls\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:27.091306 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.091101 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/481f3727-cdfd-406c-a24b-c8c11afb093b-ca-trust-extracted\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:27.401382 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.401289 2555 generic.go:356] "Generic (PLEG): container finished" podID="481f3727-cdfd-406c-a24b-c8c11afb093b" containerID="0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2" exitCode=0 Jul 10 19:00:27.401382 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.401356 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" event={"ID":"481f3727-cdfd-406c-a24b-c8c11afb093b","Type":"ContainerDied","Data":"0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2"} Jul 10 19:00:27.401382 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.401369 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" Jul 10 19:00:27.401636 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.401423 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c6f66b49-n2dpz" event={"ID":"481f3727-cdfd-406c-a24b-c8c11afb093b","Type":"ContainerDied","Data":"4c35ccf5ddfb13905cdee729327dbc51fea7f171b95c3026487290b31e39b7fa"} Jul 10 19:00:27.401636 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.401445 2555 scope.go:117] "RemoveContainer" containerID="0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2" Jul 10 19:00:27.416026 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.415999 2555 scope.go:117] "RemoveContainer" containerID="0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2" Jul 10 19:00:27.416529 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:00:27.416495 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2\": container with ID starting with 0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2 not found: ID does not exist" containerID="0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2" Jul 10 19:00:27.416649 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.416541 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2"} err="failed to get container status \"0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2\": rpc error: code = NotFound desc = could not find container \"0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2\": container with ID starting with 0a91e9009d1d25177d317596be8c6255b84f5f5132119ca06d2a83b81a0102c2 not found: ID does not exist" Jul 10 19:00:27.428026 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.428004 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59c6f66b49-n2dpz"] Jul 10 19:00:27.431892 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:27.431866 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59c6f66b49-n2dpz"] Jul 10 19:00:28.719316 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:28.719285 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="481f3727-cdfd-406c-a24b-c8c11afb093b" path="/var/lib/kubelet/pods/481f3727-cdfd-406c-a24b-c8c11afb093b/volumes" Jul 10 19:00:32.423186 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:32.423101 2555 generic.go:356] "Generic (PLEG): container finished" podID="a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db" containerID="52a340e5c845a1b7478bf7d4613489b4a48f0c79612f13d1b97a83fa4e8c3675" exitCode=0 Jul 10 19:00:32.423186 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:32.423164 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" event={"ID":"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db","Type":"ContainerDied","Data":"52a340e5c845a1b7478bf7d4613489b4a48f0c79612f13d1b97a83fa4e8c3675"} Jul 10 19:00:32.423683 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:32.423601 2555 scope.go:117] "RemoveContainer" containerID="52a340e5c845a1b7478bf7d4613489b4a48f0c79612f13d1b97a83fa4e8c3675" Jul 10 19:00:33.428691 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:33.428659 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zhm4x" event={"ID":"a5eee2d5-e1c2-4f53-abfd-707c5e9ca1db","Type":"ContainerStarted","Data":"f99f47ac50e8c351e9eea6b024320d7aba7f9f3b87fd644053468c630fae35b5"} Jul 10 19:00:34.531944 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:34.531905 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 19:00:34.535648 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:34.535624 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6cf75c4448-97vwj" Jul 10 19:00:34.709964 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:34.709906 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-794c6c698d-rnszc" podUID="81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" containerName="console" containerID="cri-o://dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64" gracePeriod=15 Jul 10 19:00:35.004054 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.004032 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794c6c698d-rnszc" Jul 10 19:00:35.062445 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.062420 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-config\") pod \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " Jul 10 19:00:35.062592 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.062453 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-oauth-serving-cert\") pod \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " Jul 10 19:00:35.062592 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.062468 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-service-ca\") pod \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " Jul 10 19:00:35.062709 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.062654 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25rlg\" (UniqueName: \"kubernetes.io/projected/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-kube-api-access-25rlg\") pod \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " Jul 10 19:00:35.062709 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.062692 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-oauth-config\") pod \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " Jul 10 19:00:35.062811 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.062721 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-serving-cert\") pod \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\" (UID: \"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca\") " Jul 10 19:00:35.062811 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.062752 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-config" (OuterVolumeSpecName: "console-config") pod "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" (UID: "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:00:35.062811 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.062767 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-service-ca" (OuterVolumeSpecName: "service-ca") pod "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" (UID: "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:00:35.062811 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.062794 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" (UID: "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:00:35.062993 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.062973 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-config\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:35.062993 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.062994 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-oauth-serving-cert\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:35.063129 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.063007 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-service-ca\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:35.064841 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.064811 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" (UID: "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:00:35.064841 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.064826 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" (UID: "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:00:35.064949 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.064826 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-kube-api-access-25rlg" (OuterVolumeSpecName: "kube-api-access-25rlg") pod "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" (UID: "81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca"). InnerVolumeSpecName "kube-api-access-25rlg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:00:35.163667 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.163599 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25rlg\" (UniqueName: \"kubernetes.io/projected/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-kube-api-access-25rlg\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:35.163667 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.163622 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-oauth-config\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:35.163667 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.163631 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca-console-serving-cert\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:00:35.437538 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.437459 2555 generic.go:356] "Generic (PLEG): container finished" podID="81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" containerID="dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64" exitCode=0 Jul 10 19:00:35.437538 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.437501 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794c6c698d-rnszc" Jul 10 19:00:35.437719 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.437543 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794c6c698d-rnszc" event={"ID":"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca","Type":"ContainerDied","Data":"dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64"} Jul 10 19:00:35.437719 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.437590 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794c6c698d-rnszc" event={"ID":"81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca","Type":"ContainerDied","Data":"b9c194e0d47a02f828da10673b7551b6cf7602008626434331ac655651b850f9"} Jul 10 19:00:35.437719 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.437612 2555 scope.go:117] "RemoveContainer" containerID="dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64" Jul 10 19:00:35.446997 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.446929 2555 scope.go:117] "RemoveContainer" containerID="dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64" Jul 10 19:00:35.447896 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:00:35.447800 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64\": container with ID starting with dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64 not found: ID does not exist" containerID="dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64" Jul 10 19:00:35.447896 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.447832 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64"} err="failed to get container status \"dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64\": rpc error: code = NotFound desc = could not find container \"dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64\": container with ID starting with dd43af338769f7b9ef23ace75566767b10be7af143d5af7cabe1ef99efa1bd64 not found: ID does not exist" Jul 10 19:00:35.459287 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.459222 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794c6c698d-rnszc"] Jul 10 19:00:35.465274 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:35.465253 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-794c6c698d-rnszc"] Jul 10 19:00:36.719592 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:36.719559 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" path="/var/lib/kubelet/pods/81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca/volumes" Jul 10 19:00:56.223516 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:56.223433 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:00:56.242440 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:56.242411 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:00:56.532386 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:00:56.532314 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:09.900226 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:09.900196 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 19:01:09.900590 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:09.900454 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="alertmanager" containerID="cri-o://4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b" gracePeriod=120 Jul 10 19:01:09.900590 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:09.900539 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy-web" containerID="cri-o://0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928" gracePeriod=120 Jul 10 19:01:09.900590 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:09.900533 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy-metric" containerID="cri-o://60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f" gracePeriod=120 Jul 10 19:01:09.900748 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:09.900569 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="config-reloader" containerID="cri-o://2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde" gracePeriod=120 Jul 10 19:01:09.900748 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:09.900607 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy" containerID="cri-o://9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038" gracePeriod=120 Jul 10 19:01:09.900748 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:09.900633 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="prom-label-proxy" containerID="cri-o://8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1" gracePeriod=120 Jul 10 19:01:10.570368 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:10.570336 2555 generic.go:356] "Generic (PLEG): container finished" podID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerID="8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1" exitCode=0 Jul 10 19:01:10.570368 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:10.570362 2555 generic.go:356] "Generic (PLEG): container finished" podID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerID="9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038" exitCode=0 Jul 10 19:01:10.570368 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:10.570370 2555 generic.go:356] "Generic (PLEG): container finished" podID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerID="2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde" exitCode=0 Jul 10 19:01:10.570368 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:10.570378 2555 generic.go:356] "Generic (PLEG): container finished" podID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerID="4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b" exitCode=0 Jul 10 19:01:10.570624 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:10.570404 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerDied","Data":"8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1"} Jul 10 19:01:10.570624 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:10.570464 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerDied","Data":"9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038"} Jul 10 19:01:10.570624 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:10.570488 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerDied","Data":"2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde"} Jul 10 19:01:10.570624 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:10.570513 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerDied","Data":"4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b"} Jul 10 19:01:11.145525 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.145502 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.224079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224051 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224260 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224093 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-trusted-ca-bundle\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224260 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224124 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-tls-assets\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224260 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224145 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-web-config\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224260 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224176 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-metrics-client-ca\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224260 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224214 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-main-tls\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224512 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224273 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-config-out\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224512 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224295 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-config-volume\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224512 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224328 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-cluster-tls-config\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224512 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224353 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjl2b\" (UniqueName: \"kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-kube-api-access-rjl2b\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224512 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224425 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224512 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224483 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.224512 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224510 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-main-db\") pod \"e8642d1b-4e05-463f-b162-b8294e819f8c\" (UID: \"e8642d1b-4e05-463f-b162-b8294e819f8c\") " Jul 10 19:01:11.225049 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.224980 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:01:11.225423 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.225391 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:01:11.226042 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.225582 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:01:11.227034 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.227005 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:11.227554 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.227433 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-config-out" (OuterVolumeSpecName: "config-out") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:01:11.227652 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.227519 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-config-volume" (OuterVolumeSpecName: "config-volume") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:11.227943 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.227883 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:01:11.228023 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.228001 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:11.228622 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.228590 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:11.228710 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.228685 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-kube-api-access-rjl2b" (OuterVolumeSpecName: "kube-api-access-rjl2b") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "kube-api-access-rjl2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:01:11.229610 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.229588 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:11.233833 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.233701 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:11.237916 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.237894 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-web-config" (OuterVolumeSpecName: "web-config") pod "e8642d1b-4e05-463f-b162-b8294e819f8c" (UID: "e8642d1b-4e05-463f-b162-b8294e819f8c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:11.325124 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325098 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325124 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325122 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325133 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-main-db\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325143 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325152 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325161 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-tls-assets\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325169 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-web-config\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325176 2555 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8642d1b-4e05-463f-b162-b8294e819f8c-metrics-client-ca\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325184 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-secret-alertmanager-main-tls\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325191 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8642d1b-4e05-463f-b162-b8294e819f8c-config-out\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325201 2555 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-config-volume\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325208 2555 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e8642d1b-4e05-463f-b162-b8294e819f8c-cluster-tls-config\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.325349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.325216 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjl2b\" (UniqueName: \"kubernetes.io/projected/e8642d1b-4e05-463f-b162-b8294e819f8c-kube-api-access-rjl2b\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:11.576884 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.576863 2555 generic.go:356] "Generic (PLEG): container finished" podID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerID="60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f" exitCode=0 Jul 10 19:01:11.576884 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.576884 2555 generic.go:356] "Generic (PLEG): container finished" podID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerID="0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928" exitCode=0 Jul 10 19:01:11.577045 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.576921 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerDied","Data":"60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f"} Jul 10 19:01:11.577045 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.576936 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.577045 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.576976 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerDied","Data":"0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928"} Jul 10 19:01:11.577045 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.577001 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8642d1b-4e05-463f-b162-b8294e819f8c","Type":"ContainerDied","Data":"2c9482d111f4c15ab5eadf5e4e1f444a2143123f34beb44d9e94cc3eb04e87d4"} Jul 10 19:01:11.577045 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.577029 2555 scope.go:117] "RemoveContainer" containerID="8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1" Jul 10 19:01:11.584713 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.584692 2555 scope.go:117] "RemoveContainer" containerID="60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f" Jul 10 19:01:11.591423 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.591408 2555 scope.go:117] "RemoveContainer" containerID="9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038" Jul 10 19:01:11.597610 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.597587 2555 scope.go:117] "RemoveContainer" containerID="0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928" Jul 10 19:01:11.602592 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.602571 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 19:01:11.605422 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.605398 2555 scope.go:117] "RemoveContainer" containerID="2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde" Jul 10 19:01:11.606513 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.606496 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 19:01:11.611856 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.611841 2555 scope.go:117] "RemoveContainer" containerID="4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b" Jul 10 19:01:11.618058 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.618044 2555 scope.go:117] "RemoveContainer" containerID="82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773" Jul 10 19:01:11.624369 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.624352 2555 scope.go:117] "RemoveContainer" containerID="8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1" Jul 10 19:01:11.624595 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:11.624577 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1\": container with ID starting with 8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1 not found: ID does not exist" containerID="8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1" Jul 10 19:01:11.624650 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.624604 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1"} err="failed to get container status \"8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1\": rpc error: code = NotFound desc = could not find container \"8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1\": container with ID starting with 8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1 not found: ID does not exist" Jul 10 19:01:11.624650 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.624620 2555 scope.go:117] "RemoveContainer" containerID="60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f" Jul 10 19:01:11.624846 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:11.624828 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f\": container with ID starting with 60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f not found: ID does not exist" containerID="60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f" Jul 10 19:01:11.624884 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.624852 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f"} err="failed to get container status \"60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f\": rpc error: code = NotFound desc = could not find container \"60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f\": container with ID starting with 60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f not found: ID does not exist" Jul 10 19:01:11.624884 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.624869 2555 scope.go:117] "RemoveContainer" containerID="9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038" Jul 10 19:01:11.625101 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:11.625085 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038\": container with ID starting with 9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038 not found: ID does not exist" containerID="9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038" Jul 10 19:01:11.625160 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.625112 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038"} err="failed to get container status \"9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038\": rpc error: code = NotFound desc = could not find container \"9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038\": container with ID starting with 9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038 not found: ID does not exist" Jul 10 19:01:11.625160 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.625132 2555 scope.go:117] "RemoveContainer" containerID="0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928" Jul 10 19:01:11.625378 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:11.625358 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928\": container with ID starting with 0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928 not found: ID does not exist" containerID="0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928" Jul 10 19:01:11.625422 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.625384 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928"} err="failed to get container status \"0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928\": rpc error: code = NotFound desc = could not find container \"0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928\": container with ID starting with 0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928 not found: ID does not exist" Jul 10 19:01:11.625422 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.625399 2555 scope.go:117] "RemoveContainer" containerID="2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde" Jul 10 19:01:11.625600 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:11.625586 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde\": container with ID starting with 2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde not found: ID does not exist" containerID="2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde" Jul 10 19:01:11.625639 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.625603 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde"} err="failed to get container status \"2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde\": rpc error: code = NotFound desc = could not find container \"2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde\": container with ID starting with 2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde not found: ID does not exist" Jul 10 19:01:11.625639 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.625614 2555 scope.go:117] "RemoveContainer" containerID="4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b" Jul 10 19:01:11.625799 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:11.625782 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b\": container with ID starting with 4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b not found: ID does not exist" containerID="4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b" Jul 10 19:01:11.625833 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.625804 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b"} err="failed to get container status \"4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b\": rpc error: code = NotFound desc = could not find container \"4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b\": container with ID starting with 4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b not found: ID does not exist" Jul 10 19:01:11.625833 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.625820 2555 scope.go:117] "RemoveContainer" containerID="82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773" Jul 10 19:01:11.626058 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:11.626039 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773\": container with ID starting with 82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773 not found: ID does not exist" containerID="82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773" Jul 10 19:01:11.626164 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.626060 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773"} err="failed to get container status \"82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773\": rpc error: code = NotFound desc = could not find container \"82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773\": container with ID starting with 82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773 not found: ID does not exist" Jul 10 19:01:11.626164 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.626073 2555 scope.go:117] "RemoveContainer" containerID="8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1" Jul 10 19:01:11.626392 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.626364 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1"} err="failed to get container status \"8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1\": rpc error: code = NotFound desc = could not find container \"8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1\": container with ID starting with 8a237ce97cec167468605cea4235ac31ea34a11a35397dd5ed41ee27424e91a1 not found: ID does not exist" Jul 10 19:01:11.626454 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.626396 2555 scope.go:117] "RemoveContainer" containerID="60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f" Jul 10 19:01:11.626785 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.626764 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f"} err="failed to get container status \"60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f\": rpc error: code = NotFound desc = could not find container \"60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f\": container with ID starting with 60860fb759db44cd798f8d56b703e4b87225af3e340c9e44d77050d328f35a0f not found: ID does not exist" Jul 10 19:01:11.626785 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.626785 2555 scope.go:117] "RemoveContainer" containerID="9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038" Jul 10 19:01:11.627081 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.627060 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038"} err="failed to get container status \"9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038\": rpc error: code = NotFound desc = could not find container \"9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038\": container with ID starting with 9c3f57f1cef868b902eb9154dde4f7fb95fa400e940987e09745df15191c3038 not found: ID does not exist" Jul 10 19:01:11.627161 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.627081 2555 scope.go:117] "RemoveContainer" containerID="0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928" Jul 10 19:01:11.627377 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.627349 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928"} err="failed to get container status \"0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928\": rpc error: code = NotFound desc = could not find container \"0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928\": container with ID starting with 0a3e4f93bc78973ec9c71b1d5742661ad33c8372c0817a23900b2c66d202d928 not found: ID does not exist" Jul 10 19:01:11.627377 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.627372 2555 scope.go:117] "RemoveContainer" containerID="2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde" Jul 10 19:01:11.627611 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.627595 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde"} err="failed to get container status \"2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde\": rpc error: code = NotFound desc = could not find container \"2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde\": container with ID starting with 2b367fd5b84c1dc14e5e0c1f9bee253df4c59915931ca0493d7533f781980fde not found: ID does not exist" Jul 10 19:01:11.627680 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.627613 2555 scope.go:117] "RemoveContainer" containerID="4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b" Jul 10 19:01:11.627849 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.627833 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b"} err="failed to get container status \"4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b\": rpc error: code = NotFound desc = could not find container \"4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b\": container with ID starting with 4761d3e30c81c40d73e58d31bb83ece24db6092eaaa5a43c8fd05b329f32c17b not found: ID does not exist" Jul 10 19:01:11.627889 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.627850 2555 scope.go:117] "RemoveContainer" containerID="82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773" Jul 10 19:01:11.628032 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.628016 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773"} err="failed to get container status \"82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773\": rpc error: code = NotFound desc = could not find container \"82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773\": container with ID starting with 82de1908668809b2b77e2f2db250a662e8fef05dc4d82dfad7a2a1faeabc0773 not found: ID does not exist" Jul 10 19:01:11.636656 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636637 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 19:01:11.636884 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636873 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="init-config-reloader" Jul 10 19:01:11.636937 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636885 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="init-config-reloader" Jul 10 19:01:11.636937 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636895 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy-web" Jul 10 19:01:11.636937 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636902 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy-web" Jul 10 19:01:11.636937 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636910 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="481f3727-cdfd-406c-a24b-c8c11afb093b" containerName="registry" Jul 10 19:01:11.636937 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636915 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="481f3727-cdfd-406c-a24b-c8c11afb093b" containerName="registry" Jul 10 19:01:11.636937 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636925 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy" Jul 10 19:01:11.636937 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636930 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy" Jul 10 19:01:11.636937 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636938 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="prom-label-proxy" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636944 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="prom-label-proxy" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636951 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" containerName="console" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636956 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" containerName="console" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636963 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy-metric" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636968 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy-metric" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636976 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="config-reloader" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636981 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="config-reloader" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636988 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="alertmanager" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.636993 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="alertmanager" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.637034 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="81e5bbe6-9196-43e5-b11b-b3dfe1bb2bca" containerName="console" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.637041 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="alertmanager" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.637048 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.637053 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="481f3727-cdfd-406c-a24b-c8c11afb093b" containerName="registry" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.637059 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="prom-label-proxy" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.637064 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="config-reloader" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.637069 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy-web" Jul 10 19:01:11.637207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.637073 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" containerName="kube-rbac-proxy-metric" Jul 10 19:01:11.644035 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.643998 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.646932 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.646916 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 19:01:11.648116 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.648096 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 19:01:11.648197 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.648124 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 19:01:11.648508 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.648492 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 19:01:11.648586 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.648573 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 19:01:11.648646 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.648588 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bfzbb\"" Jul 10 19:01:11.648646 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.648597 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 19:01:11.648646 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.648618 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 19:01:11.648791 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.648691 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 19:01:11.653898 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.653880 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 19:01:11.659902 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.659872 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 19:01:11.728357 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728333 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728357 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-web-config\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728488 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728375 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728488 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728391 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7spdv\" (UniqueName: \"kubernetes.io/projected/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-kube-api-access-7spdv\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728554 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728500 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-config-out\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728554 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728621 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728560 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728621 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728579 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728715 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728653 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728715 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728699 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728807 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728727 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728807 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728770 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.728889 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.728805 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.829754 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829683 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.829754 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829714 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7spdv\" (UniqueName: \"kubernetes.io/projected/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-kube-api-access-7spdv\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.829754 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829743 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-config-out\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.829995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829759 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.829995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829780 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.829995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829805 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.829995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829832 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.829995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829870 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.829995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829897 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.829995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829936 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.829995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829972 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.830407 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.829998 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.830407 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.830021 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-web-config\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.830407 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.830360 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.831008 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.830980 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.832695 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.832597 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-config-out\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.832983 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.832848 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-web-config\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.832983 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.832885 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.833194 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.833165 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.833296 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.833207 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.833296 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.833276 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.833413 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.833339 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.833529 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.833510 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.833641 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.833623 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.834218 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.834202 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.838413 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.838397 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7spdv\" (UniqueName: \"kubernetes.io/projected/9ca647e8-bae9-4ed7-b641-9aefd0fc3464-kube-api-access-7spdv\") pod \"alertmanager-main-0\" (UID: \"9ca647e8-bae9-4ed7-b641-9aefd0fc3464\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:11.953047 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:11.953026 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 19:01:12.086945 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:12.086922 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 19:01:12.089100 ip-10-0-134-251 kubenswrapper[2555]: W0710 19:01:12.089070 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca647e8_bae9_4ed7_b641_9aefd0fc3464.slice/crio-25f7b41cb6da3451c2782c67b92cf5156e0f28db0deebcfe1bf7e88a4750ee6a WatchSource:0}: Error finding container 25f7b41cb6da3451c2782c67b92cf5156e0f28db0deebcfe1bf7e88a4750ee6a: Status 404 returned error can't find the container with id 25f7b41cb6da3451c2782c67b92cf5156e0f28db0deebcfe1bf7e88a4750ee6a Jul 10 19:01:12.177071 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:12.177046 2555 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca647e8_bae9_4ed7_b641_9aefd0fc3464.slice/crio-conmon-e81d8f290e7471a3b84b0752bbd82c3ae1defb418aa04ebcfcee0a638438675b.scope\": RecentStats: unable to find data in memory cache]" Jul 10 19:01:12.581913 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:12.581883 2555 generic.go:356] "Generic (PLEG): container finished" podID="9ca647e8-bae9-4ed7-b641-9aefd0fc3464" containerID="e81d8f290e7471a3b84b0752bbd82c3ae1defb418aa04ebcfcee0a638438675b" exitCode=0 Jul 10 19:01:12.582044 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:12.581964 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ca647e8-bae9-4ed7-b641-9aefd0fc3464","Type":"ContainerDied","Data":"e81d8f290e7471a3b84b0752bbd82c3ae1defb418aa04ebcfcee0a638438675b"} Jul 10 19:01:12.582044 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:12.582032 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ca647e8-bae9-4ed7-b641-9aefd0fc3464","Type":"ContainerStarted","Data":"25f7b41cb6da3451c2782c67b92cf5156e0f28db0deebcfe1bf7e88a4750ee6a"} Jul 10 19:01:12.719208 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:12.719184 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8642d1b-4e05-463f-b162-b8294e819f8c" path="/var/lib/kubelet/pods/e8642d1b-4e05-463f-b162-b8294e819f8c/volumes" Jul 10 19:01:13.594359 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.594325 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ca647e8-bae9-4ed7-b641-9aefd0fc3464","Type":"ContainerStarted","Data":"92e15fa6275ab34137c7af924b549fe7356bbf2abd84a43c85e3ac94a88c0586"} Jul 10 19:01:13.594684 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.594408 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ca647e8-bae9-4ed7-b641-9aefd0fc3464","Type":"ContainerStarted","Data":"252662d000ca16e8c47c527cae3a7820ed54597b19ce01622b00fa19d6b0f9cd"} Jul 10 19:01:13.594684 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.594434 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ca647e8-bae9-4ed7-b641-9aefd0fc3464","Type":"ContainerStarted","Data":"b41e91bed48c4578550482f24490dff5344c9cbe21f33d106bf0796c9ec73f2b"} Jul 10 19:01:13.594684 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.594468 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ca647e8-bae9-4ed7-b641-9aefd0fc3464","Type":"ContainerStarted","Data":"18f9a956b8eb143b6729a714df3a1e1c253cda02c6b6531143f7c3c8afcc9d1f"} Jul 10 19:01:13.594684 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.594495 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ca647e8-bae9-4ed7-b641-9aefd0fc3464","Type":"ContainerStarted","Data":"08a511b0c0e5019fdeac264678596f1803fe3817621a7f2fd8bec407530f35fc"} Jul 10 19:01:13.594684 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.594517 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ca647e8-bae9-4ed7-b641-9aefd0fc3464","Type":"ContainerStarted","Data":"5706451655e59f9c06ce8e6d62789c2f2bc5a5059a3c2980e4b4f1f14373c0dc"} Jul 10 19:01:13.625160 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.625040 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.610606666 podStartE2EDuration="2.625023931s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.417265ms" isStatefulPod=false podCreationTimestamp="2026-07-10 19:01:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:01:13.623148702 +0000 UTC m=+193.375326421" watchObservedRunningTime="2026-07-10 19:01:13.625023931 +0000 UTC m=+193.377201653" Jul 10 19:01:13.955581 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.955509 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c99f46c59-tscjl"] Jul 10 19:01:13.957897 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.957881 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:13.960867 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.960844 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 10 19:01:13.960988 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.960927 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p968z\"" Jul 10 19:01:13.961194 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.961179 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 10 19:01:13.961356 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.961339 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 10 19:01:13.961443 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.961426 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 10 19:01:13.961644 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.961628 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 10 19:01:13.966459 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.966438 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 10 19:01:13.983024 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:13.983006 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c99f46c59-tscjl"] Jul 10 19:01:14.048315 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.048296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-telemeter-client-tls\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.048403 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.048329 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-serving-certs-ca-bundle\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.048403 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.048349 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-secret-telemeter-client\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.048403 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.048367 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.048535 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.048431 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-metrics-client-ca\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.048535 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.048457 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xwl2\" (UniqueName: \"kubernetes.io/projected/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-kube-api-access-6xwl2\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.048535 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.048479 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-federate-client-tls\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.048535 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.048496 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.149476 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.149434 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-serving-certs-ca-bundle\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.149476 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.149476 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-secret-telemeter-client\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.149666 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.149496 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.149666 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.149530 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-metrics-client-ca\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.149666 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.149551 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xwl2\" (UniqueName: \"kubernetes.io/projected/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-kube-api-access-6xwl2\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.149666 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.149571 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-federate-client-tls\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.149666 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.149586 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.149666 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.149634 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-telemeter-client-tls\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.150289 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.150260 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-serving-certs-ca-bundle\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.150467 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.150444 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-metrics-client-ca\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.150581 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.150561 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.152423 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.152400 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-secret-telemeter-client\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.152590 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.152569 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-telemeter-client-tls\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.152633 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.152608 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.152633 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.152623 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-federate-client-tls\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.158425 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.158405 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xwl2\" (UniqueName: \"kubernetes.io/projected/14c91fb3-802d-4f01-ade8-db47bfaf1fb0-kube-api-access-6xwl2\") pod \"telemeter-client-7c99f46c59-tscjl\" (UID: \"14c91fb3-802d-4f01-ade8-db47bfaf1fb0\") " pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.267107 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.267060 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" Jul 10 19:01:14.272044 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.272023 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 19:01:14.272313 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.272284 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="prometheus" containerID="cri-o://41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5" gracePeriod=600 Jul 10 19:01:14.272313 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.272296 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy" containerID="cri-o://dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a" gracePeriod=600 Jul 10 19:01:14.272442 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.272335 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83" gracePeriod=600 Jul 10 19:01:14.272442 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.272350 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="thanos-sidecar" containerID="cri-o://80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0" gracePeriod=600 Jul 10 19:01:14.272442 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.272368 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy-web" containerID="cri-o://73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61" gracePeriod=600 Jul 10 19:01:14.272442 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.272424 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="config-reloader" containerID="cri-o://db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f" gracePeriod=600 Jul 10 19:01:14.429926 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.429894 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c99f46c59-tscjl"] Jul 10 19:01:14.433530 ip-10-0-134-251 kubenswrapper[2555]: W0710 19:01:14.433500 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c91fb3_802d_4f01_ade8_db47bfaf1fb0.slice/crio-faa5d96c95f01c5aed29498f0d1a9b7f5692acc182d5b65b925cfa702a97e630 WatchSource:0}: Error finding container faa5d96c95f01c5aed29498f0d1a9b7f5692acc182d5b65b925cfa702a97e630: Status 404 returned error can't find the container with id faa5d96c95f01c5aed29498f0d1a9b7f5692acc182d5b65b925cfa702a97e630 Jul 10 19:01:14.512796 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.512772 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.552598 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552530 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-web-config\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.552598 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552566 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-grpc-tls\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.552598 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552593 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config-out\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.552853 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552625 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-tls\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.552853 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552663 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-2\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.552853 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552689 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-0\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.552853 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552711 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.552853 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552750 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-metrics-client-certs\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.552853 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552784 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-kube-rbac-proxy\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.552853 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552822 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.552853 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552856 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjpfh\" (UniqueName: \"kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-kube-api-access-rjpfh\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.553298 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552892 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-serving-certs-ca-bundle\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.553298 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552927 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-tls-assets\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.553298 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.552971 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-trusted-ca-bundle\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.553298 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.553003 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-kubelet-serving-ca-bundle\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.553298 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.553029 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.553298 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.553059 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-metrics-client-ca\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.553298 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.553097 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-db\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.553298 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.553138 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-1\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.553298 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.553166 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-thanos-prometheus-http-client-file\") pod \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\" (UID: \"5bdf8fc4-3605-4a45-92a3-5afc12ae7023\") " Jul 10 19:01:14.553714 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.553665 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:01:14.555992 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.555944 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:01:14.558493 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.556384 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:01:14.558493 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.556898 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:01:14.558493 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.556906 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:01:14.558493 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.557043 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:01:14.558493 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.558468 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:01:14.558799 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.557046 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:14.558799 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.557725 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:01:14.558799 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.558118 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:14.559737 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.559707 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:14.559737 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.559727 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:14.559945 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.559812 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:14.559945 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.559875 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config" (OuterVolumeSpecName: "config") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:14.559945 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.559902 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:14.560099 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.559981 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config-out" (OuterVolumeSpecName: "config-out") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:01:14.560414 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.560382 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-kube-api-access-rjpfh" (OuterVolumeSpecName: "kube-api-access-rjpfh") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "kube-api-access-rjpfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:01:14.561083 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.561061 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:01:14.561476 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.561453 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:14.568564 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.568541 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-web-config" (OuterVolumeSpecName: "web-config") pod "5bdf8fc4-3605-4a45-92a3-5afc12ae7023" (UID: "5bdf8fc4-3605-4a45-92a3-5afc12ae7023"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:14.601615 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601582 2555 generic.go:356] "Generic (PLEG): container finished" podID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerID="a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83" exitCode=0 Jul 10 19:01:14.601615 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601611 2555 generic.go:356] "Generic (PLEG): container finished" podID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerID="dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a" exitCode=0 Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601621 2555 generic.go:356] "Generic (PLEG): container finished" podID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerID="73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61" exitCode=0 Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601617 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerDied","Data":"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83"} Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601686 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601692 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerDied","Data":"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a"} Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601630 2555 generic.go:356] "Generic (PLEG): container finished" podID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerID="80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0" exitCode=0 Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601719 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerDied","Data":"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61"} Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601723 2555 generic.go:356] "Generic (PLEG): container finished" podID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerID="db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f" exitCode=0 Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601737 2555 generic.go:356] "Generic (PLEG): container finished" podID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerID="41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5" exitCode=0 Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601744 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerDied","Data":"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0"} Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601773 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerDied","Data":"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f"} Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601791 2555 scope.go:117] "RemoveContainer" containerID="a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83" Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601806 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerDied","Data":"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5"} Jul 10 19:01:14.601995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.601831 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bdf8fc4-3605-4a45-92a3-5afc12ae7023","Type":"ContainerDied","Data":"9b2da0ce56577ddb48933e21fd5ae80d47d00d9fa592707dd38a34781662fe22"} Jul 10 19:01:14.603175 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.603153 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" event={"ID":"14c91fb3-802d-4f01-ade8-db47bfaf1fb0","Type":"ContainerStarted","Data":"faa5d96c95f01c5aed29498f0d1a9b7f5692acc182d5b65b925cfa702a97e630"} Jul 10 19:01:14.609464 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.609443 2555 scope.go:117] "RemoveContainer" containerID="dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a" Jul 10 19:01:14.615982 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.615969 2555 scope.go:117] "RemoveContainer" containerID="73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61" Jul 10 19:01:14.622215 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.622198 2555 scope.go:117] "RemoveContainer" containerID="80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0" Jul 10 19:01:14.626501 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.626480 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 19:01:14.628795 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.628768 2555 scope.go:117] "RemoveContainer" containerID="db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f" Jul 10 19:01:14.639060 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.639036 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 19:01:14.640408 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.640388 2555 scope.go:117] "RemoveContainer" containerID="41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5" Jul 10 19:01:14.647093 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.647077 2555 scope.go:117] "RemoveContainer" containerID="9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0" Jul 10 19:01:14.653308 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.653294 2555 scope.go:117] "RemoveContainer" containerID="a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83" Jul 10 19:01:14.653527 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:14.653508 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": container with ID starting with a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83 not found: ID does not exist" containerID="a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83" Jul 10 19:01:14.653574 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.653534 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83"} err="failed to get container status \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": rpc error: code = NotFound desc = could not find container \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": container with ID starting with a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83 not found: ID does not exist" Jul 10 19:01:14.653574 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.653551 2555 scope.go:117] "RemoveContainer" containerID="dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a" Jul 10 19:01:14.653775 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:14.653757 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": container with ID starting with dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a not found: ID does not exist" containerID="dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a" Jul 10 19:01:14.653820 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.653778 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a"} err="failed to get container status \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": rpc error: code = NotFound desc = could not find container \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": container with ID starting with dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a not found: ID does not exist" Jul 10 19:01:14.653820 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.653789 2555 scope.go:117] "RemoveContainer" containerID="73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61" Jul 10 19:01:14.654257 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:14.654076 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": container with ID starting with 73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61 not found: ID does not exist" containerID="73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61" Jul 10 19:01:14.654257 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654112 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61"} err="failed to get container status \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": rpc error: code = NotFound desc = could not find container \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": container with ID starting with 73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61 not found: ID does not exist" Jul 10 19:01:14.654257 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654134 2555 scope.go:117] "RemoveContainer" containerID="80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0" Jul 10 19:01:14.654257 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654201 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-tls-assets\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654257 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654221 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654257 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654256 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654272 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654287 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-metrics-client-ca\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654300 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-db\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654315 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654329 2555 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654342 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-web-config\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654357 2555 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-grpc-tls\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654370 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config-out\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654396 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654412 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654428 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654448 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654463 2555 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-metrics-client-certs\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654473 2555 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-secret-kube-rbac-proxy\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654482 2555 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-config\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654489 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjpfh\" (UniqueName: \"kubernetes.io/projected/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-kube-api-access-rjpfh\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654497 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bdf8fc4-3605-4a45-92a3-5afc12ae7023-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:14.654425 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": container with ID starting with 80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0 not found: ID does not exist" containerID="80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654517 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0"} err="failed to get container status \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": rpc error: code = NotFound desc = could not find container \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": container with ID starting with 80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0 not found: ID does not exist" Jul 10 19:01:14.654549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654531 2555 scope.go:117] "RemoveContainer" containerID="db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f" Jul 10 19:01:14.655089 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:14.654728 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": container with ID starting with db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f not found: ID does not exist" containerID="db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f" Jul 10 19:01:14.655089 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654746 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f"} err="failed to get container status \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": rpc error: code = NotFound desc = could not find container \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": container with ID starting with db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f not found: ID does not exist" Jul 10 19:01:14.655089 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654759 2555 scope.go:117] "RemoveContainer" containerID="41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5" Jul 10 19:01:14.655089 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:14.654945 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": container with ID starting with 41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5 not found: ID does not exist" containerID="41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5" Jul 10 19:01:14.655089 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654966 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5"} err="failed to get container status \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": rpc error: code = NotFound desc = could not find container \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": container with ID starting with 41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5 not found: ID does not exist" Jul 10 19:01:14.655089 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.654979 2555 scope.go:117] "RemoveContainer" containerID="9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0" Jul 10 19:01:14.655303 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:01:14.655167 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": container with ID starting with 9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0 not found: ID does not exist" containerID="9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0" Jul 10 19:01:14.655303 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.655184 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0"} err="failed to get container status \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": rpc error: code = NotFound desc = could not find container \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": container with ID starting with 9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0 not found: ID does not exist" Jul 10 19:01:14.655303 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.655196 2555 scope.go:117] "RemoveContainer" containerID="a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83" Jul 10 19:01:14.655440 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.655423 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83"} err="failed to get container status \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": rpc error: code = NotFound desc = could not find container \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": container with ID starting with a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83 not found: ID does not exist" Jul 10 19:01:14.655478 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.655441 2555 scope.go:117] "RemoveContainer" containerID="dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a" Jul 10 19:01:14.655642 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.655627 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a"} err="failed to get container status \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": rpc error: code = NotFound desc = could not find container \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": container with ID starting with dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a not found: ID does not exist" Jul 10 19:01:14.655685 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.655642 2555 scope.go:117] "RemoveContainer" containerID="73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61" Jul 10 19:01:14.655840 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.655823 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61"} err="failed to get container status \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": rpc error: code = NotFound desc = could not find container \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": container with ID starting with 73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61 not found: ID does not exist" Jul 10 19:01:14.655899 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.655841 2555 scope.go:117] "RemoveContainer" containerID="80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0" Jul 10 19:01:14.656009 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.655994 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0"} err="failed to get container status \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": rpc error: code = NotFound desc = could not find container \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": container with ID starting with 80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0 not found: ID does not exist" Jul 10 19:01:14.656051 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.656009 2555 scope.go:117] "RemoveContainer" containerID="db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f" Jul 10 19:01:14.656198 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.656178 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f"} err="failed to get container status \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": rpc error: code = NotFound desc = could not find container \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": container with ID starting with db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f not found: ID does not exist" Jul 10 19:01:14.656312 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.656203 2555 scope.go:117] "RemoveContainer" containerID="41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5" Jul 10 19:01:14.656921 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.656901 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5"} err="failed to get container status \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": rpc error: code = NotFound desc = could not find container \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": container with ID starting with 41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5 not found: ID does not exist" Jul 10 19:01:14.656921 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.656920 2555 scope.go:117] "RemoveContainer" containerID="9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0" Jul 10 19:01:14.657181 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.657156 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0"} err="failed to get container status \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": rpc error: code = NotFound desc = could not find container \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": container with ID starting with 9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0 not found: ID does not exist" Jul 10 19:01:14.657181 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.657175 2555 scope.go:117] "RemoveContainer" containerID="a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83" Jul 10 19:01:14.657413 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.657391 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83"} err="failed to get container status \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": rpc error: code = NotFound desc = could not find container \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": container with ID starting with a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83 not found: ID does not exist" Jul 10 19:01:14.657463 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.657414 2555 scope.go:117] "RemoveContainer" containerID="dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a" Jul 10 19:01:14.657602 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.657583 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a"} err="failed to get container status \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": rpc error: code = NotFound desc = could not find container \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": container with ID starting with dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a not found: ID does not exist" Jul 10 19:01:14.657649 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.657602 2555 scope.go:117] "RemoveContainer" containerID="73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61" Jul 10 19:01:14.657800 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.657780 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61"} err="failed to get container status \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": rpc error: code = NotFound desc = could not find container \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": container with ID starting with 73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61 not found: ID does not exist" Jul 10 19:01:14.657800 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.657798 2555 scope.go:117] "RemoveContainer" containerID="80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0" Jul 10 19:01:14.657939 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.657911 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 19:01:14.658019 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658001 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0"} err="failed to get container status \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": rpc error: code = NotFound desc = could not find container \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": container with ID starting with 80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0 not found: ID does not exist" Jul 10 19:01:14.658019 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658018 2555 scope.go:117] "RemoveContainer" containerID="db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f" Jul 10 19:01:14.658224 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658210 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f"} err="failed to get container status \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": rpc error: code = NotFound desc = could not find container \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": container with ID starting with db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f not found: ID does not exist" Jul 10 19:01:14.658224 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658223 2555 scope.go:117] "RemoveContainer" containerID="41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5" Jul 10 19:01:14.658339 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658273 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy" Jul 10 19:01:14.658339 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658289 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy" Jul 10 19:01:14.658339 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658304 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="prometheus" Jul 10 19:01:14.658339 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658313 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="prometheus" Jul 10 19:01:14.658339 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658325 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy-web" Jul 10 19:01:14.658339 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658333 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy-web" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658345 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="config-reloader" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658354 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="config-reloader" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658375 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="init-config-reloader" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658383 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="init-config-reloader" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658393 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy-thanos" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658400 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy-thanos" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658412 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="thanos-sidecar" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658422 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="thanos-sidecar" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658466 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5"} err="failed to get container status \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": rpc error: code = NotFound desc = could not find container \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": container with ID starting with 41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5 not found: ID does not exist" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658483 2555 scope.go:117] "RemoveContainer" containerID="9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658491 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy-thanos" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658502 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy-web" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658513 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="config-reloader" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658522 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="kube-rbac-proxy" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658533 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="thanos-sidecar" Jul 10 19:01:14.658614 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658543 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" containerName="prometheus" Jul 10 19:01:14.659349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658710 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0"} err="failed to get container status \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": rpc error: code = NotFound desc = could not find container \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": container with ID starting with 9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0 not found: ID does not exist" Jul 10 19:01:14.659349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658728 2555 scope.go:117] "RemoveContainer" containerID="a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83" Jul 10 19:01:14.659349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658936 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83"} err="failed to get container status \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": rpc error: code = NotFound desc = could not find container \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": container with ID starting with a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83 not found: ID does not exist" Jul 10 19:01:14.659349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.658949 2555 scope.go:117] "RemoveContainer" containerID="dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a" Jul 10 19:01:14.659349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.659137 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a"} err="failed to get container status \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": rpc error: code = NotFound desc = could not find container \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": container with ID starting with dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a not found: ID does not exist" Jul 10 19:01:14.659349 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.659152 2555 scope.go:117] "RemoveContainer" containerID="73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61" Jul 10 19:01:14.659619 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.659378 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61"} err="failed to get container status \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": rpc error: code = NotFound desc = could not find container \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": container with ID starting with 73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61 not found: ID does not exist" Jul 10 19:01:14.659619 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.659394 2555 scope.go:117] "RemoveContainer" containerID="80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0" Jul 10 19:01:14.659619 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.659562 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0"} err="failed to get container status \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": rpc error: code = NotFound desc = could not find container \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": container with ID starting with 80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0 not found: ID does not exist" Jul 10 19:01:14.659619 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.659578 2555 scope.go:117] "RemoveContainer" containerID="db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f" Jul 10 19:01:14.659798 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.659762 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f"} err="failed to get container status \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": rpc error: code = NotFound desc = could not find container \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": container with ID starting with db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f not found: ID does not exist" Jul 10 19:01:14.659798 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.659777 2555 scope.go:117] "RemoveContainer" containerID="41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5" Jul 10 19:01:14.659982 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.659962 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5"} err="failed to get container status \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": rpc error: code = NotFound desc = could not find container \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": container with ID starting with 41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5 not found: ID does not exist" Jul 10 19:01:14.659982 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.659981 2555 scope.go:117] "RemoveContainer" containerID="9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0" Jul 10 19:01:14.660206 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.660187 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0"} err="failed to get container status \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": rpc error: code = NotFound desc = could not find container \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": container with ID starting with 9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0 not found: ID does not exist" Jul 10 19:01:14.660206 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.660205 2555 scope.go:117] "RemoveContainer" containerID="a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83" Jul 10 19:01:14.660417 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.660400 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83"} err="failed to get container status \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": rpc error: code = NotFound desc = could not find container \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": container with ID starting with a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83 not found: ID does not exist" Jul 10 19:01:14.660457 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.660417 2555 scope.go:117] "RemoveContainer" containerID="dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a" Jul 10 19:01:14.660621 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.660605 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a"} err="failed to get container status \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": rpc error: code = NotFound desc = could not find container \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": container with ID starting with dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a not found: ID does not exist" Jul 10 19:01:14.660657 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.660629 2555 scope.go:117] "RemoveContainer" containerID="73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61" Jul 10 19:01:14.660855 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.660839 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61"} err="failed to get container status \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": rpc error: code = NotFound desc = could not find container \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": container with ID starting with 73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61 not found: ID does not exist" Jul 10 19:01:14.660902 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.660855 2555 scope.go:117] "RemoveContainer" containerID="80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0" Jul 10 19:01:14.661054 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.661036 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0"} err="failed to get container status \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": rpc error: code = NotFound desc = could not find container \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": container with ID starting with 80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0 not found: ID does not exist" Jul 10 19:01:14.661093 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.661055 2555 scope.go:117] "RemoveContainer" containerID="db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f" Jul 10 19:01:14.661283 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.661264 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f"} err="failed to get container status \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": rpc error: code = NotFound desc = could not find container \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": container with ID starting with db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f not found: ID does not exist" Jul 10 19:01:14.661319 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.661285 2555 scope.go:117] "RemoveContainer" containerID="41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5" Jul 10 19:01:14.661484 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.661468 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5"} err="failed to get container status \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": rpc error: code = NotFound desc = could not find container \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": container with ID starting with 41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5 not found: ID does not exist" Jul 10 19:01:14.661519 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.661485 2555 scope.go:117] "RemoveContainer" containerID="9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0" Jul 10 19:01:14.661698 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.661680 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0"} err="failed to get container status \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": rpc error: code = NotFound desc = could not find container \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": container with ID starting with 9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0 not found: ID does not exist" Jul 10 19:01:14.661761 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.661700 2555 scope.go:117] "RemoveContainer" containerID="a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83" Jul 10 19:01:14.661915 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.661897 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83"} err="failed to get container status \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": rpc error: code = NotFound desc = could not find container \"a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83\": container with ID starting with a1a1c7203405e349ecaee50fc514032b25facd12bcc51fc39439b8ed4d48bc83 not found: ID does not exist" Jul 10 19:01:14.661915 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.661914 2555 scope.go:117] "RemoveContainer" containerID="dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a" Jul 10 19:01:14.662102 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.662086 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a"} err="failed to get container status \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": rpc error: code = NotFound desc = could not find container \"dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a\": container with ID starting with dbc44e9dd317b8f68f349202ecf9718384ae4bb8ac72ae11b4b7a42e72d2da5a not found: ID does not exist" Jul 10 19:01:14.662146 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.662104 2555 scope.go:117] "RemoveContainer" containerID="73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61" Jul 10 19:01:14.662331 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.662317 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61"} err="failed to get container status \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": rpc error: code = NotFound desc = could not find container \"73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61\": container with ID starting with 73c3befd959150fa29c5f649c04c30600e94aded2c866dcee9e3d135a8580a61 not found: ID does not exist" Jul 10 19:01:14.662331 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.662331 2555 scope.go:117] "RemoveContainer" containerID="80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0" Jul 10 19:01:14.662516 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.662498 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0"} err="failed to get container status \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": rpc error: code = NotFound desc = could not find container \"80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0\": container with ID starting with 80474625d535e1d1cd98057182d1718b7ea40731d8dcf6020814804bdf2fe1b0 not found: ID does not exist" Jul 10 19:01:14.662556 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.662517 2555 scope.go:117] "RemoveContainer" containerID="db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f" Jul 10 19:01:14.662556 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.662544 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.662791 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.662770 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f"} err="failed to get container status \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": rpc error: code = NotFound desc = could not find container \"db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f\": container with ID starting with db1c8ec79990c7d3ccd1083dcf4c5918f9909462900ec961c9b3d569b2e17c4f not found: ID does not exist" Jul 10 19:01:14.662791 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.662792 2555 scope.go:117] "RemoveContainer" containerID="41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5" Jul 10 19:01:14.663057 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.663023 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5"} err="failed to get container status \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": rpc error: code = NotFound desc = could not find container \"41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5\": container with ID starting with 41eb53d75e074f7586da9ae4407489f779505fa67ec681d1851c9e35b0cd58e5 not found: ID does not exist" Jul 10 19:01:14.663057 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.663056 2555 scope.go:117] "RemoveContainer" containerID="9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0" Jul 10 19:01:14.663325 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.663302 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0"} err="failed to get container status \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": rpc error: code = NotFound desc = could not find container \"9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0\": container with ID starting with 9a906e7b394cb520f28927aec9f77b1779f7d7cc49af995d19d147f1ff264fa0 not found: ID does not exist" Jul 10 19:01:14.665333 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.665316 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 19:01:14.665414 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.665347 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 19:01:14.665414 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.665352 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 19:01:14.665414 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.665380 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 19:01:14.665751 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.665729 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 19:01:14.665751 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.665746 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 19:01:14.665965 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.665952 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 19:01:14.666042 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.666022 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 19:01:14.666042 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.666036 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-frk50q8vn0eh9\"" Jul 10 19:01:14.666125 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.666071 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 19:01:14.666173 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.666165 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-85grh\"" Jul 10 19:01:14.666385 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.666370 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 19:01:14.666450 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.666372 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 19:01:14.666629 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.666614 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 19:01:14.669559 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.669541 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 19:01:14.672926 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.672905 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 19:01:14.677394 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.677377 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 19:01:14.719369 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.719348 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bdf8fc4-3605-4a45-92a3-5afc12ae7023" path="/var/lib/kubelet/pods/5bdf8fc4-3605-4a45-92a3-5afc12ae7023/volumes" Jul 10 19:01:14.754751 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.754731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.754816 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.754756 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.754816 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.754773 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb68q\" (UniqueName: \"kubernetes.io/projected/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-kube-api-access-lb68q\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.754816 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.754791 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.754933 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.754915 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.754977 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.754949 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755017 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.754976 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755017 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755007 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755089 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755041 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755089 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755074 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755150 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755115 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755150 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755138 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755206 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755161 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755206 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755183 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755300 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755207 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-config\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755300 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755222 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755300 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755265 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755300 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755282 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755431 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755311 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.755431 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.755331 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856203 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856178 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856322 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856214 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856322 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856247 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856322 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856270 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856322 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856290 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856322 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856306 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856600 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856322 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856600 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856578 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856706 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856619 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856706 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856650 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856706 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856673 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856847 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856715 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-config\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856847 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856741 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856847 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856769 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856847 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856798 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.856847 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856835 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.857069 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856859 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.857069 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856894 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.857069 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856918 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.857069 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.856947 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb68q\" (UniqueName: \"kubernetes.io/projected/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-kube-api-access-lb68q\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.858180 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.857376 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.858180 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.857495 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.858180 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.857806 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.858180 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.857986 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.858420 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.858185 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.858805 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.858502 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.859293 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.859012 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.859619 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.859597 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.859960 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.859938 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.862010 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.860072 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.862182 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.861301 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.862311 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.861335 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.862311 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.861530 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.862311 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.861870 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.862311 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.861979 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.862311 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.862056 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.863448 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.863428 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.863448 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.863440 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.863630 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.863448 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-config\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.868294 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.868278 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb68q\" (UniqueName: \"kubernetes.io/projected/7417bb7d-b7c3-4c42-bbfc-d09d419975b7-kube-api-access-lb68q\") pod \"prometheus-k8s-0\" (UID: \"7417bb7d-b7c3-4c42-bbfc-d09d419975b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:14.973455 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:14.973432 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:01:15.109337 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:15.109265 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 19:01:15.112161 ip-10-0-134-251 kubenswrapper[2555]: W0710 19:01:15.112137 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7417bb7d_b7c3_4c42_bbfc_d09d419975b7.slice/crio-5a9143387bdd4f06820ad798035ba846b48ee283080af2fd03191385569cabdd WatchSource:0}: Error finding container 5a9143387bdd4f06820ad798035ba846b48ee283080af2fd03191385569cabdd: Status 404 returned error can't find the container with id 5a9143387bdd4f06820ad798035ba846b48ee283080af2fd03191385569cabdd Jul 10 19:01:15.609845 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:15.609809 2555 generic.go:356] "Generic (PLEG): container finished" podID="7417bb7d-b7c3-4c42-bbfc-d09d419975b7" containerID="cb49b7fee6dcd35a3fd34f00d86fe4e5d2627e01b9a398b4a80db3144c7c9f6a" exitCode=0 Jul 10 19:01:15.610260 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:15.609897 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7417bb7d-b7c3-4c42-bbfc-d09d419975b7","Type":"ContainerDied","Data":"cb49b7fee6dcd35a3fd34f00d86fe4e5d2627e01b9a398b4a80db3144c7c9f6a"} Jul 10 19:01:15.610260 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:15.609978 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7417bb7d-b7c3-4c42-bbfc-d09d419975b7","Type":"ContainerStarted","Data":"5a9143387bdd4f06820ad798035ba846b48ee283080af2fd03191385569cabdd"} Jul 10 19:01:16.616803 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:16.616697 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" event={"ID":"14c91fb3-802d-4f01-ade8-db47bfaf1fb0","Type":"ContainerStarted","Data":"5dbd55680df57b834a02f655d3cd32163f615703c600fe627ecb9f77ebb664e6"} Jul 10 19:01:16.620693 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:16.620669 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7417bb7d-b7c3-4c42-bbfc-d09d419975b7","Type":"ContainerStarted","Data":"0e9f8fcadee7ecb77dcbfc6affc9e38e8a85b441c500e768ece3069780e6f8b1"} Jul 10 19:01:16.620785 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:16.620735 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7417bb7d-b7c3-4c42-bbfc-d09d419975b7","Type":"ContainerStarted","Data":"48226c2bc1945d733694db2577325e537018ed3d5343289fd469efd604be070d"} Jul 10 19:01:16.620785 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:16.620773 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7417bb7d-b7c3-4c42-bbfc-d09d419975b7","Type":"ContainerStarted","Data":"0eef27700fa3911d59f82e08c245ed714e570a7a3cd6fae6a42511625f0afc04"} Jul 10 19:01:16.620903 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:16.620810 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7417bb7d-b7c3-4c42-bbfc-d09d419975b7","Type":"ContainerStarted","Data":"2d90b577522e4027c5fcdf5a00ffaa4cba7adeede703f1229d818cfc7bbcc79d"} Jul 10 19:01:16.620903 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:16.620850 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7417bb7d-b7c3-4c42-bbfc-d09d419975b7","Type":"ContainerStarted","Data":"3d39cec4fb3cbd537bf802495f2e95a780ad079914d5c437dfbc28610fb24799"} Jul 10 19:01:16.620903 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:16.620890 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7417bb7d-b7c3-4c42-bbfc-d09d419975b7","Type":"ContainerStarted","Data":"8bae80d61a176590993181152ba4b72faabb5a5ff7b2dad0e068f51a036e2de4"} Jul 10 19:01:16.665688 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:16.665643 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.646346805 podStartE2EDuration="2.66562619s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.279385ms" isStatefulPod=false podCreationTimestamp="2026-07-10 19:01:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:01:16.658067013 +0000 UTC m=+196.410244746" watchObservedRunningTime="2026-07-10 19:01:16.66562619 +0000 UTC m=+196.417803912" Jul 10 19:01:17.627504 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:17.627464 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" event={"ID":"14c91fb3-802d-4f01-ade8-db47bfaf1fb0","Type":"ContainerStarted","Data":"a366ee46c633d94a6c0a3b11feb230d3453dd5f1811ee427b4fa261f1ad6c423"} Jul 10 19:01:17.627864 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:17.627530 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" event={"ID":"14c91fb3-802d-4f01-ade8-db47bfaf1fb0","Type":"ContainerStarted","Data":"bf5bf531e8a67beb54fa09e4d4497e94d480a1f9798a51f53e4b09ac80224047"} Jul 10 19:01:17.653934 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:17.653894 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c99f46c59-tscjl" podStartSLOduration=2.542997109 podStartE2EDuration="4.653880001s" totalImagesPullingTime="2.110882892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:01:17.652140104 +0000 UTC m=+197.404317821" watchObservedRunningTime="2026-07-10 19:01:17.653880001 +0000 UTC m=+197.406057719" Jul 10 19:01:19.974088 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:01:19.974051 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:02:14.974070 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:02:14.974035 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:02:14.988930 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:02:14.988905 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:02:15.857025 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:02:15.857001 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 19:03:00.617453 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:03:00.617416 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:03:00.622221 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:03:00.622198 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:03:00.624773 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:03:00.624753 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 19:06:33.574212 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.574173 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84864fc95-7cvdf"] Jul 10 19:06:33.577640 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.577617 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.582358 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.582336 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 19:06:33.583806 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.583781 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 19:06:33.583920 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.583837 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 19:06:33.584331 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.584092 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 19:06:33.584950 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.584930 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d6shc\"" Jul 10 19:06:33.585207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.585154 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 19:06:33.585320 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.585216 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 19:06:33.585320 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.585274 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 19:06:33.587833 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.587812 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 19:06:33.594168 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.594144 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84864fc95-7cvdf"] Jul 10 19:06:33.680111 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.680078 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-console-config\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.680111 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.680114 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-service-ca\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.680329 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.680135 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-oauth-serving-cert\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.680329 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.680196 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-trusted-ca-bundle\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.680329 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.680270 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6aaf478-74c6-498d-8266-d75bc175c48b-console-oauth-config\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.680329 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.680316 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6aaf478-74c6-498d-8266-d75bc175c48b-console-serving-cert\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.680456 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.680356 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vmhn\" (UniqueName: \"kubernetes.io/projected/c6aaf478-74c6-498d-8266-d75bc175c48b-kube-api-access-6vmhn\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.781660 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.781617 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-console-config\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.781863 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.781683 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-service-ca\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.781863 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.781711 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-oauth-serving-cert\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.781863 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.781740 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-trusted-ca-bundle\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.781863 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.781763 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6aaf478-74c6-498d-8266-d75bc175c48b-console-oauth-config\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.782069 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.781908 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6aaf478-74c6-498d-8266-d75bc175c48b-console-serving-cert\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.782069 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.781971 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vmhn\" (UniqueName: \"kubernetes.io/projected/c6aaf478-74c6-498d-8266-d75bc175c48b-kube-api-access-6vmhn\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.782503 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.782476 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-console-config\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.782603 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.782520 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-oauth-serving-cert\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.782603 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.782528 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-service-ca\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.782683 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.782621 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6aaf478-74c6-498d-8266-d75bc175c48b-trusted-ca-bundle\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.784746 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.784726 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6aaf478-74c6-498d-8266-d75bc175c48b-console-oauth-config\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.784746 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.784738 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6aaf478-74c6-498d-8266-d75bc175c48b-console-serving-cert\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.792198 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.792179 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vmhn\" (UniqueName: \"kubernetes.io/projected/c6aaf478-74c6-498d-8266-d75bc175c48b-kube-api-access-6vmhn\") pod \"console-84864fc95-7cvdf\" (UID: \"c6aaf478-74c6-498d-8266-d75bc175c48b\") " pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:33.887144 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:33.887104 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:34.013313 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:34.013193 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84864fc95-7cvdf"] Jul 10 19:06:34.015984 ip-10-0-134-251 kubenswrapper[2555]: W0710 19:06:34.015960 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6aaf478_74c6_498d_8266_d75bc175c48b.slice/crio-48641adf62ebb3871151048a264a7b6e3f05214eda1c28d99a964b0ad660117d WatchSource:0}: Error finding container 48641adf62ebb3871151048a264a7b6e3f05214eda1c28d99a964b0ad660117d: Status 404 returned error can't find the container with id 48641adf62ebb3871151048a264a7b6e3f05214eda1c28d99a964b0ad660117d Jul 10 19:06:34.799506 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:34.799474 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84864fc95-7cvdf" event={"ID":"c6aaf478-74c6-498d-8266-d75bc175c48b","Type":"ContainerStarted","Data":"b49a6ea5a5b678fb9150b934195a9abce3b176a514d3e71ca701fbec3beaa6dd"} Jul 10 19:06:34.799959 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:34.799531 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84864fc95-7cvdf" event={"ID":"c6aaf478-74c6-498d-8266-d75bc175c48b","Type":"ContainerStarted","Data":"48641adf62ebb3871151048a264a7b6e3f05214eda1c28d99a964b0ad660117d"} Jul 10 19:06:34.823813 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:34.823765 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84864fc95-7cvdf" podStartSLOduration=1.8237509969999999 podStartE2EDuration="1.823750997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:06:34.821301879 +0000 UTC m=+514.573479598" watchObservedRunningTime="2026-07-10 19:06:34.823750997 +0000 UTC m=+514.575928716" Jul 10 19:06:43.887450 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:43.887420 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:43.887807 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:43.887471 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:43.892079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:43.892059 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:06:44.842922 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:06:44.842895 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84864fc95-7cvdf" Jul 10 19:07:00.009687 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.009617 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-654w9"] Jul 10 19:07:00.013028 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.013005 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-654w9" Jul 10 19:07:00.015725 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.015707 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 10 19:07:00.015819 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.015740 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 10 19:07:00.016994 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.016976 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-gztcg\"" Jul 10 19:07:00.017082 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.017069 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 10 19:07:00.021549 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.021529 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-654w9"] Jul 10 19:07:00.102954 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.102907 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-model-cache\") pod \"s3-init-654w9\" (UID: \"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7\") " pod="kserve/s3-init-654w9" Jul 10 19:07:00.103143 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.102975 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlqnr\" (UniqueName: \"kubernetes.io/projected/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-kube-api-access-mlqnr\") pod \"s3-init-654w9\" (UID: \"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7\") " pod="kserve/s3-init-654w9" Jul 10 19:07:00.203685 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.203649 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-model-cache\") pod \"s3-init-654w9\" (UID: \"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7\") " pod="kserve/s3-init-654w9" Jul 10 19:07:00.203856 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.203702 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqnr\" (UniqueName: \"kubernetes.io/projected/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-kube-api-access-mlqnr\") pod \"s3-init-654w9\" (UID: \"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7\") " pod="kserve/s3-init-654w9" Jul 10 19:07:00.204024 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.204004 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-model-cache\") pod \"s3-init-654w9\" (UID: \"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7\") " pod="kserve/s3-init-654w9" Jul 10 19:07:00.212273 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.212227 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlqnr\" (UniqueName: \"kubernetes.io/projected/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-kube-api-access-mlqnr\") pod \"s3-init-654w9\" (UID: \"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7\") " pod="kserve/s3-init-654w9" Jul 10 19:07:00.330664 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.330625 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-654w9" Jul 10 19:07:00.461588 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.461567 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-654w9"] Jul 10 19:07:00.463572 ip-10-0-134-251 kubenswrapper[2555]: W0710 19:07:00.463548 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5d94ab9_12c5_4dec_803b_e7cb8da9e9c7.slice/crio-7159c1425a545889888c0d792bb1cb7ee1cdba34e1e8dbd0f4702c98c3f82d1b WatchSource:0}: Error finding container 7159c1425a545889888c0d792bb1cb7ee1cdba34e1e8dbd0f4702c98c3f82d1b: Status 404 returned error can't find the container with id 7159c1425a545889888c0d792bb1cb7ee1cdba34e1e8dbd0f4702c98c3f82d1b Jul 10 19:07:00.465354 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.465338 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 19:07:00.899091 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:00.899056 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-654w9" event={"ID":"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7","Type":"ContainerStarted","Data":"7159c1425a545889888c0d792bb1cb7ee1cdba34e1e8dbd0f4702c98c3f82d1b"} Jul 10 19:07:03.914156 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:03.914074 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-654w9" event={"ID":"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7","Type":"ContainerStarted","Data":"b9b84eb2e4bf71d877ee13ce06cdb1dffd314afc4de166be3b951a68c2850892"} Jul 10 19:07:28.013275 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:28.013215 2555 generic.go:356] "Generic (PLEG): container finished" podID="c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7" containerID="b9b84eb2e4bf71d877ee13ce06cdb1dffd314afc4de166be3b951a68c2850892" exitCode=0 Jul 10 19:07:28.013666 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:28.013290 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-654w9" event={"ID":"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7","Type":"ContainerDied","Data":"b9b84eb2e4bf71d877ee13ce06cdb1dffd314afc4de166be3b951a68c2850892"} Jul 10 19:07:32.574795 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:32.574773 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 10 19:07:33.037307 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:33.037266 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-654w9" event={"ID":"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7","Type":"ContainerStarted","Data":"711534a5db39a3082de798cbbc0148b7e0a8264e5806656b5edfd3ac4e5e521a"} Jul 10 19:07:33.057017 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:07:33.056973 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-654w9" podStartSLOduration=2.838678575 podStartE2EDuration="34.056959875s" totalImagesPullingTime="7.731599791s" totalInitContainerRuntime="23.486681509s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:06:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:07:33.05651005 +0000 UTC m=+572.808687792" watchObservedRunningTime="2026-07-10 19:07:33.056959875 +0000 UTC m=+572.809137594" Jul 10 19:08:00.651451 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:00.651405 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:08:00.653675 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:00.653653 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:08:38.296457 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:38.296421 2555 generic.go:356] "Generic (PLEG): container finished" podID="c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7" containerID="711534a5db39a3082de798cbbc0148b7e0a8264e5806656b5edfd3ac4e5e521a" exitCode=0 Jul 10 19:08:38.296861 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:38.296499 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-654w9" event={"ID":"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7","Type":"ContainerDied","Data":"711534a5db39a3082de798cbbc0148b7e0a8264e5806656b5edfd3ac4e5e521a"} Jul 10 19:08:39.419018 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:39.418997 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-654w9" Jul 10 19:08:39.569048 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:39.568969 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlqnr\" (UniqueName: \"kubernetes.io/projected/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-kube-api-access-mlqnr\") pod \"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7\" (UID: \"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7\") " Jul 10 19:08:39.569048 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:39.569013 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-model-cache\") pod \"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7\" (UID: \"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7\") " Jul 10 19:08:39.571113 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:39.571084 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-kube-api-access-mlqnr" (OuterVolumeSpecName: "kube-api-access-mlqnr") pod "c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7" (UID: "c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7"). InnerVolumeSpecName "kube-api-access-mlqnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:08:39.587439 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:39.587415 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-model-cache" (OuterVolumeSpecName: "model-cache") pod "c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7" (UID: "c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:08:39.669489 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:39.669464 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlqnr\" (UniqueName: \"kubernetes.io/projected/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-kube-api-access-mlqnr\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:08:39.669489 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:39.669488 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7-model-cache\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:08:40.305512 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:40.305443 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-654w9" Jul 10 19:08:40.305512 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:40.305454 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-654w9" event={"ID":"c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7","Type":"ContainerDied","Data":"7159c1425a545889888c0d792bb1cb7ee1cdba34e1e8dbd0f4702c98c3f82d1b"} Jul 10 19:08:40.305512 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:40.305488 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7159c1425a545889888c0d792bb1cb7ee1cdba34e1e8dbd0f4702c98c3f82d1b" Jul 10 19:08:52.132951 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.132922 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf"] Jul 10 19:08:52.133318 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.133270 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7" containerName="download-hf-model" Jul 10 19:08:52.133318 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.133282 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7" containerName="download-hf-model" Jul 10 19:08:52.133318 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.133290 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7" containerName="s3-init" Jul 10 19:08:52.133318 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.133295 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7" containerName="s3-init" Jul 10 19:08:52.133452 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.133355 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7" containerName="s3-init" Jul 10 19:08:52.136431 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.136411 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.139493 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.139469 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Jul 10 19:08:52.139658 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.139643 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 10 19:08:52.139838 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.139798 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-hm6ps\"" Jul 10 19:08:52.140086 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.140072 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 10 19:08:52.140940 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.140923 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Jul 10 19:08:52.141021 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.140924 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 10 19:08:52.141021 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.140962 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 10 19:08:52.156751 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.156726 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf"] Jul 10 19:08:52.170103 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.170075 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxnps\" (UniqueName: \"kubernetes.io/projected/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-api-access-gxnps\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.170212 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.170116 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/892aec3e-7a7a-4985-86fc-00d21e6d061a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.170212 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.170150 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/892aec3e-7a7a-4985-86fc-00d21e6d061a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.170212 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.170175 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.170212 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.170208 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.271025 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.270987 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxnps\" (UniqueName: \"kubernetes.io/projected/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-api-access-gxnps\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.271183 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.271038 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/892aec3e-7a7a-4985-86fc-00d21e6d061a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.271183 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.271070 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/892aec3e-7a7a-4985-86fc-00d21e6d061a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.271183 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.271093 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.271183 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.271123 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.271371 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:08:52.271215 2555 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Jul 10 19:08:52.271371 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:08:52.271331 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892aec3e-7a7a-4985-86fc-00d21e6d061a-proxy-tls podName:892aec3e-7a7a-4985-86fc-00d21e6d061a nodeName:}" failed. No retries permitted until 2026-07-10 19:08:52.7713102 +0000 UTC m=+652.523487897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/892aec3e-7a7a-4985-86fc-00d21e6d061a-proxy-tls") pod "isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" (UID: "892aec3e-7a7a-4985-86fc-00d21e6d061a") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Jul 10 19:08:52.271515 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.271493 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/892aec3e-7a7a-4985-86fc-00d21e6d061a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.271877 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.271858 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.271920 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.271906 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.282966 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.282944 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxnps\" (UniqueName: \"kubernetes.io/projected/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-api-access-gxnps\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.331469 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.331446 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68"] Jul 10 19:08:52.334906 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.334891 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.337771 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.337753 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Jul 10 19:08:52.337927 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.337912 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Jul 10 19:08:52.345544 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.345524 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68"] Jul 10 19:08:52.371682 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.371661 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.371789 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.371698 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.371789 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.371725 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a3bb143-a851-45dd-a549-894efa39b4ce-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.371868 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.371807 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr47t\" (UniqueName: \"kubernetes.io/projected/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-api-access-jr47t\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.371868 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.371850 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a3bb143-a851-45dd-a549-894efa39b4ce-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.472787 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.472725 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr47t\" (UniqueName: \"kubernetes.io/projected/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-api-access-jr47t\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.472787 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.472754 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a3bb143-a851-45dd-a549-894efa39b4ce-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.472787 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.472783 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.472975 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.472818 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.472975 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.472857 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a3bb143-a851-45dd-a549-894efa39b4ce-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.473224 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.473204 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a3bb143-a851-45dd-a549-894efa39b4ce-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.473466 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.473449 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.473508 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.473493 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.475076 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.475059 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a3bb143-a851-45dd-a549-894efa39b4ce-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.484631 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.484604 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr47t\" (UniqueName: \"kubernetes.io/projected/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-api-access-jr47t\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hkw68\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.645568 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.645531 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:08:52.769534 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.769465 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68"] Jul 10 19:08:52.771792 ip-10-0-134-251 kubenswrapper[2555]: W0710 19:08:52.771755 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3bb143_a851_45dd_a549_894efa39b4ce.slice/crio-d7e4dc968c5ca39ae3c275d3c2a72b2191b7b24535d852e29726605e90ce05dc WatchSource:0}: Error finding container d7e4dc968c5ca39ae3c275d3c2a72b2191b7b24535d852e29726605e90ce05dc: Status 404 returned error can't find the container with id d7e4dc968c5ca39ae3c275d3c2a72b2191b7b24535d852e29726605e90ce05dc Jul 10 19:08:52.775668 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.775649 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/892aec3e-7a7a-4985-86fc-00d21e6d061a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:52.777816 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:52.777791 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/892aec3e-7a7a-4985-86fc-00d21e6d061a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:53.046729 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:53.046657 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:08:53.170144 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:53.170123 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf"] Jul 10 19:08:53.357415 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:53.357367 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" event={"ID":"892aec3e-7a7a-4985-86fc-00d21e6d061a","Type":"ContainerStarted","Data":"ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3"} Jul 10 19:08:53.357594 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:53.357453 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" event={"ID":"892aec3e-7a7a-4985-86fc-00d21e6d061a","Type":"ContainerStarted","Data":"b089795f707daafbd6d78240c35b5b5f6a0563d98fbeb4485395b56cf1824634"} Jul 10 19:08:53.359022 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:53.358989 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" event={"ID":"5a3bb143-a851-45dd-a549-894efa39b4ce","Type":"ContainerStarted","Data":"e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543"} Jul 10 19:08:53.359115 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:53.359059 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" event={"ID":"5a3bb143-a851-45dd-a549-894efa39b4ce","Type":"ContainerStarted","Data":"d7e4dc968c5ca39ae3c275d3c2a72b2191b7b24535d852e29726605e90ce05dc"} Jul 10 19:08:57.381702 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:57.381671 2555 generic.go:356] "Generic (PLEG): container finished" podID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerID="ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3" exitCode=0 Jul 10 19:08:57.382132 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:57.381748 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" event={"ID":"892aec3e-7a7a-4985-86fc-00d21e6d061a","Type":"ContainerDied","Data":"ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3"} Jul 10 19:08:57.383483 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:57.383463 2555 generic.go:356] "Generic (PLEG): container finished" podID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerID="e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543" exitCode=0 Jul 10 19:08:57.383585 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:08:57.383515 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" event={"ID":"5a3bb143-a851-45dd-a549-894efa39b4ce","Type":"ContainerDied","Data":"e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543"} Jul 10 19:09:20.524471 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:20.524444 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" event={"ID":"892aec3e-7a7a-4985-86fc-00d21e6d061a","Type":"ContainerStarted","Data":"845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2"} Jul 10 19:09:21.531583 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:21.531533 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" event={"ID":"5a3bb143-a851-45dd-a549-894efa39b4ce","Type":"ContainerStarted","Data":"31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105"} Jul 10 19:09:23.543524 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:23.543488 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" event={"ID":"892aec3e-7a7a-4985-86fc-00d21e6d061a","Type":"ContainerStarted","Data":"8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2"} Jul 10 19:09:23.543938 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:23.543651 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:09:23.545546 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:23.545519 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" event={"ID":"5a3bb143-a851-45dd-a549-894efa39b4ce","Type":"ContainerStarted","Data":"d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8"} Jul 10 19:09:23.545675 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:23.545660 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:09:23.565989 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:23.565946 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podStartSLOduration=2.827651897 podStartE2EDuration="31.565933081s" totalImagesPullingTime="25.115807317s" totalInitContainerRuntime="3.622473867s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:08:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:09:23.563080091 +0000 UTC m=+683.315257821" watchObservedRunningTime="2026-07-10 19:09:23.565933081 +0000 UTC m=+683.318110799" Jul 10 19:09:23.582701 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:23.582663 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" podStartSLOduration=2.833305664 podStartE2EDuration="31.582651183s" totalImagesPullingTime="25.053159634s" totalInitContainerRuntime="3.696185885s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:08:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:09:23.581867373 +0000 UTC m=+683.334045128" watchObservedRunningTime="2026-07-10 19:09:23.582651183 +0000 UTC m=+683.334828901" Jul 10 19:09:24.549914 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:24.549883 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:09:24.550268 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:24.549943 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:09:24.550957 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:24.550917 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 10 19:09:24.550957 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:24.550944 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 10 19:09:25.553464 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:25.553419 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 10 19:09:25.553896 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:25.553499 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 10 19:09:30.557451 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:30.557423 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:09:30.557846 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:30.557756 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:09:30.557889 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:30.557864 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 10 19:09:30.558317 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:30.558293 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 10 19:09:40.557874 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:40.557836 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 10 19:09:40.558209 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:40.558116 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 10 19:09:50.558266 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:50.558220 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 10 19:09:50.558721 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:09:50.558212 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 10 19:10:00.558496 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:10:00.558415 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 10 19:10:00.558894 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:10:00.558415 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 10 19:10:10.557867 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:10:10.557828 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 10 19:10:10.558308 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:10:10.558167 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 10 19:10:20.558363 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:10:20.558334 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:10:20.558769 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:10:20.558597 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 10 19:10:30.558879 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:10:30.558849 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:11:02.157249 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:02.157207 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68"] Jul 10 19:11:02.157749 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:02.157475 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kserve-container" containerID="cri-o://31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105" gracePeriod=30 Jul 10 19:11:02.157826 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:02.157786 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kube-rbac-proxy" containerID="cri-o://d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8" gracePeriod=30 Jul 10 19:11:02.257897 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:02.257869 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf"] Jul 10 19:11:02.258124 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:02.258100 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" containerID="cri-o://845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2" gracePeriod=30 Jul 10 19:11:02.258224 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:02.258198 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kube-rbac-proxy" containerID="cri-o://8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2" gracePeriod=30 Jul 10 19:11:02.944883 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:02.944849 2555 generic.go:356] "Generic (PLEG): container finished" podID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerID="8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2" exitCode=2 Jul 10 19:11:02.945056 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:02.944925 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" event={"ID":"892aec3e-7a7a-4985-86fc-00d21e6d061a","Type":"ContainerDied","Data":"8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2"} Jul 10 19:11:02.946943 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:02.946921 2555 generic.go:356] "Generic (PLEG): container finished" podID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerID="d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8" exitCode=2 Jul 10 19:11:02.947050 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:02.946965 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" event={"ID":"5a3bb143-a851-45dd-a549-894efa39b4ce","Type":"ContainerDied","Data":"d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8"} Jul 10 19:11:05.410217 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.410196 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:11:05.484668 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.484614 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr47t\" (UniqueName: \"kubernetes.io/projected/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-api-access-jr47t\") pod \"5a3bb143-a851-45dd-a549-894efa39b4ce\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " Jul 10 19:11:05.484668 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.484652 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-rbac-proxy-sar-config\") pod \"5a3bb143-a851-45dd-a549-894efa39b4ce\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " Jul 10 19:11:05.484833 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.484785 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-cabundle-cert\") pod \"5a3bb143-a851-45dd-a549-894efa39b4ce\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " Jul 10 19:11:05.484889 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.484838 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a3bb143-a851-45dd-a549-894efa39b4ce-proxy-tls\") pod \"5a3bb143-a851-45dd-a549-894efa39b4ce\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " Jul 10 19:11:05.484945 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.484883 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a3bb143-a851-45dd-a549-894efa39b4ce-kserve-provision-location\") pod \"5a3bb143-a851-45dd-a549-894efa39b4ce\" (UID: \"5a3bb143-a851-45dd-a549-894efa39b4ce\") " Jul 10 19:11:05.484992 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.484936 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "5a3bb143-a851-45dd-a549-894efa39b4ce" (UID: "5a3bb143-a851-45dd-a549-894efa39b4ce"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:11:05.485163 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.485138 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "5a3bb143-a851-45dd-a549-894efa39b4ce" (UID: "5a3bb143-a851-45dd-a549-894efa39b4ce"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:11:05.485226 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.485163 2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:11:05.485284 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.485261 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a3bb143-a851-45dd-a549-894efa39b4ce-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "5a3bb143-a851-45dd-a549-894efa39b4ce" (UID: "5a3bb143-a851-45dd-a549-894efa39b4ce"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:05.486701 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.486681 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a3bb143-a851-45dd-a549-894efa39b4ce-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5a3bb143-a851-45dd-a549-894efa39b4ce" (UID: "5a3bb143-a851-45dd-a549-894efa39b4ce"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:11:05.486873 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.486850 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-api-access-jr47t" (OuterVolumeSpecName: "kube-api-access-jr47t") pod "5a3bb143-a851-45dd-a549-894efa39b4ce" (UID: "5a3bb143-a851-45dd-a549-894efa39b4ce"). InnerVolumeSpecName "kube-api-access-jr47t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:11:05.554533 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.554504 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.26:8643/healthz\": dial tcp 10.132.0.26:8643: connect: connection refused" Jul 10 19:11:05.585581 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.585559 2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5a3bb143-a851-45dd-a549-894efa39b4ce-cabundle-cert\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:11:05.585581 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.585580 2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a3bb143-a851-45dd-a549-894efa39b4ce-proxy-tls\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:11:05.585693 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.585589 2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a3bb143-a851-45dd-a549-894efa39b4ce-kserve-provision-location\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:11:05.585693 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.585598 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr47t\" (UniqueName: \"kubernetes.io/projected/5a3bb143-a851-45dd-a549-894efa39b4ce-kube-api-access-jr47t\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:11:05.960036 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.960005 2555 generic.go:356] "Generic (PLEG): container finished" podID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerID="31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105" exitCode=0 Jul 10 19:11:05.960188 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.960052 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" Jul 10 19:11:05.960188 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.960084 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" event={"ID":"5a3bb143-a851-45dd-a549-894efa39b4ce","Type":"ContainerDied","Data":"31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105"} Jul 10 19:11:05.960188 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.960144 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68" event={"ID":"5a3bb143-a851-45dd-a549-894efa39b4ce","Type":"ContainerDied","Data":"d7e4dc968c5ca39ae3c275d3c2a72b2191b7b24535d852e29726605e90ce05dc"} Jul 10 19:11:05.960188 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.960177 2555 scope.go:117] "RemoveContainer" containerID="d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8" Jul 10 19:11:05.970054 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.969981 2555 scope.go:117] "RemoveContainer" containerID="31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105" Jul 10 19:11:05.977485 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.977471 2555 scope.go:117] "RemoveContainer" containerID="e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543" Jul 10 19:11:05.984284 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.984267 2555 scope.go:117] "RemoveContainer" containerID="d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8" Jul 10 19:11:05.984568 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:11:05.984550 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8\": container with ID starting with d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8 not found: ID does not exist" containerID="d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8" Jul 10 19:11:05.984688 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.984578 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8"} err="failed to get container status \"d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8\": rpc error: code = NotFound desc = could not find container \"d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8\": container with ID starting with d529c33f10d5022ddad2f04532e0a446993679c8a26d40e01d98425af7dff3d8 not found: ID does not exist" Jul 10 19:11:05.984688 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.984600 2555 scope.go:117] "RemoveContainer" containerID="31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105" Jul 10 19:11:05.984842 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:11:05.984826 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105\": container with ID starting with 31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105 not found: ID does not exist" containerID="31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105" Jul 10 19:11:05.984884 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.984848 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105"} err="failed to get container status \"31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105\": rpc error: code = NotFound desc = could not find container \"31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105\": container with ID starting with 31f0802dfef38c3893eb2df71694bdabda4b50185f4ca1e7176d2726bb6e2105 not found: ID does not exist" Jul 10 19:11:05.984884 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.984863 2555 scope.go:117] "RemoveContainer" containerID="e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543" Jul 10 19:11:05.985074 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:11:05.985057 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543\": container with ID starting with e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543 not found: ID does not exist" containerID="e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543" Jul 10 19:11:05.985126 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.985081 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543"} err="failed to get container status \"e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543\": rpc error: code = NotFound desc = could not find container \"e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543\": container with ID starting with e45fc413539cc63a6f9b0d8145260dc4e037474ef6abb5cfc9a18fac1f604543 not found: ID does not exist" Jul 10 19:11:05.985806 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.985788 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68"] Jul 10 19:11:05.993198 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:05.993178 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hkw68"] Jul 10 19:11:06.496723 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.496699 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:11:06.595112 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.595091 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/892aec3e-7a7a-4985-86fc-00d21e6d061a-kserve-provision-location\") pod \"892aec3e-7a7a-4985-86fc-00d21e6d061a\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " Jul 10 19:11:06.595226 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.595129 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-rbac-proxy-sar-config\") pod \"892aec3e-7a7a-4985-86fc-00d21e6d061a\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " Jul 10 19:11:06.595226 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.595155 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/892aec3e-7a7a-4985-86fc-00d21e6d061a-proxy-tls\") pod \"892aec3e-7a7a-4985-86fc-00d21e6d061a\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " Jul 10 19:11:06.595226 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.595174 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxnps\" (UniqueName: \"kubernetes.io/projected/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-api-access-gxnps\") pod \"892aec3e-7a7a-4985-86fc-00d21e6d061a\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " Jul 10 19:11:06.595402 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.595256 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-cabundle-cert\") pod \"892aec3e-7a7a-4985-86fc-00d21e6d061a\" (UID: \"892aec3e-7a7a-4985-86fc-00d21e6d061a\") " Jul 10 19:11:06.595554 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.595473 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/892aec3e-7a7a-4985-86fc-00d21e6d061a-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "892aec3e-7a7a-4985-86fc-00d21e6d061a" (UID: "892aec3e-7a7a-4985-86fc-00d21e6d061a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:06.595610 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.595572 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "892aec3e-7a7a-4985-86fc-00d21e6d061a" (UID: "892aec3e-7a7a-4985-86fc-00d21e6d061a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:11:06.595705 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.595683 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "892aec3e-7a7a-4985-86fc-00d21e6d061a" (UID: "892aec3e-7a7a-4985-86fc-00d21e6d061a"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:11:06.597149 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.597131 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-api-access-gxnps" (OuterVolumeSpecName: "kube-api-access-gxnps") pod "892aec3e-7a7a-4985-86fc-00d21e6d061a" (UID: "892aec3e-7a7a-4985-86fc-00d21e6d061a"). InnerVolumeSpecName "kube-api-access-gxnps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:11:06.597207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.597180 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/892aec3e-7a7a-4985-86fc-00d21e6d061a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "892aec3e-7a7a-4985-86fc-00d21e6d061a" (UID: "892aec3e-7a7a-4985-86fc-00d21e6d061a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:11:06.696354 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.696330 2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-cabundle-cert\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:11:06.696354 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.696350 2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/892aec3e-7a7a-4985-86fc-00d21e6d061a-kserve-provision-location\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:11:06.696503 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.696361 2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:11:06.696503 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.696370 2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/892aec3e-7a7a-4985-86fc-00d21e6d061a-proxy-tls\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:11:06.696503 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.696378 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxnps\" (UniqueName: \"kubernetes.io/projected/892aec3e-7a7a-4985-86fc-00d21e6d061a-kube-api-access-gxnps\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:11:06.720038 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.720013 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" path="/var/lib/kubelet/pods/5a3bb143-a851-45dd-a549-894efa39b4ce/volumes" Jul 10 19:11:06.966738 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.966675 2555 generic.go:356] "Generic (PLEG): container finished" podID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerID="845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2" exitCode=0 Jul 10 19:11:06.966738 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.966711 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" event={"ID":"892aec3e-7a7a-4985-86fc-00d21e6d061a","Type":"ContainerDied","Data":"845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2"} Jul 10 19:11:06.966738 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.966730 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" Jul 10 19:11:06.966952 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.966755 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf" event={"ID":"892aec3e-7a7a-4985-86fc-00d21e6d061a","Type":"ContainerDied","Data":"b089795f707daafbd6d78240c35b5b5f6a0563d98fbeb4485395b56cf1824634"} Jul 10 19:11:06.966952 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.966783 2555 scope.go:117] "RemoveContainer" containerID="8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2" Jul 10 19:11:06.975353 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.975326 2555 scope.go:117] "RemoveContainer" containerID="845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2" Jul 10 19:11:06.986938 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.986914 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf"] Jul 10 19:11:06.987997 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.987971 2555 scope.go:117] "RemoveContainer" containerID="ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3" Jul 10 19:11:06.989334 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.989311 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-545bb6c58f-smkcf"] Jul 10 19:11:06.994726 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.994709 2555 scope.go:117] "RemoveContainer" containerID="8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2" Jul 10 19:11:06.994955 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:11:06.994939 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2\": container with ID starting with 8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2 not found: ID does not exist" containerID="8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2" Jul 10 19:11:06.994995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.994961 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2"} err="failed to get container status \"8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2\": rpc error: code = NotFound desc = could not find container \"8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2\": container with ID starting with 8703d259c8ef5ca3948d1e7904c0579b43aebd2a844b9cdb89699a1c1a2042b2 not found: ID does not exist" Jul 10 19:11:06.994995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.994975 2555 scope.go:117] "RemoveContainer" containerID="845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2" Jul 10 19:11:06.995205 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:11:06.995186 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2\": container with ID starting with 845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2 not found: ID does not exist" containerID="845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2" Jul 10 19:11:06.995255 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.995220 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2"} err="failed to get container status \"845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2\": rpc error: code = NotFound desc = could not find container \"845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2\": container with ID starting with 845b257b3c567b4184f36cdb55988c757374ed766264d8e99b9fa4f6435fdde2 not found: ID does not exist" Jul 10 19:11:06.995291 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.995260 2555 scope.go:117] "RemoveContainer" containerID="ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3" Jul 10 19:11:06.995469 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:11:06.995452 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3\": container with ID starting with ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3 not found: ID does not exist" containerID="ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3" Jul 10 19:11:06.995509 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:06.995478 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3"} err="failed to get container status \"ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3\": rpc error: code = NotFound desc = could not find container \"ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3\": container with ID starting with ee3f7f0c4f4afa1e45f8935c4461dda5018ab6c7cae48b78000d2e24ef3b3eb3 not found: ID does not exist" Jul 10 19:11:08.719568 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:11:08.719530 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" path="/var/lib/kubelet/pods/892aec3e-7a7a-4985-86fc-00d21e6d061a/volumes" Jul 10 19:13:00.679053 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:13:00.678975 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:13:00.679642 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:13:00.679614 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:18:00.704270 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:18:00.704223 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:18:00.705330 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:18:00.705311 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:23:00.730249 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:23:00.730212 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:23:00.732163 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:23:00.732142 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:28:00.755426 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:28:00.755393 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:28:00.758328 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:28:00.758303 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:33:00.780492 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:33:00.780462 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:33:00.784343 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:33:00.784323 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:38:00.805604 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:38:00.805498 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:38:00.811653 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:38:00.811634 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:43:00.830859 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:43:00.830827 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:43:00.838375 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:43:00.838356 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:48:00.859273 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:00.859146 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:48:00.865417 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:00.865400 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:48:02.890425 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890390 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2nln4/must-gather-b2sv2"] Jul 10 19:48:02.890879 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890826 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="storage-initializer" Jul 10 19:48:02.890879 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890844 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="storage-initializer" Jul 10 19:48:02.890879 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890873 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kserve-container" Jul 10 19:48:02.890879 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890881 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kserve-container" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890891 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kube-rbac-proxy" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890899 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kube-rbac-proxy" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890917 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kube-rbac-proxy" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890926 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kube-rbac-proxy" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890939 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890947 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890960 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="storage-initializer" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.890969 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="storage-initializer" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.891047 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kube-rbac-proxy" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.891060 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kube-rbac-proxy" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.891069 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="892aec3e-7a7a-4985-86fc-00d21e6d061a" containerName="kserve-container" Jul 10 19:48:02.891079 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.891078 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a3bb143-a851-45dd-a549-894efa39b4ce" containerName="kserve-container" Jul 10 19:48:02.894098 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.894079 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:02.896894 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.896874 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2nln4\"/\"openshift-service-ca.crt\"" Jul 10 19:48:02.896987 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.896937 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2nln4\"/\"kube-root-ca.crt\"" Jul 10 19:48:02.898136 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.898121 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2nln4\"/\"default-dockercfg-zrt22\"" Jul 10 19:48:02.901990 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.901969 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2nln4/must-gather-b2sv2"] Jul 10 19:48:02.954059 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.954033 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2d5k\" (UniqueName: \"kubernetes.io/projected/e9213f57-299d-4f0f-95a2-f9d393e566e2-kube-api-access-j2d5k\") pod \"must-gather-b2sv2\" (UID: \"e9213f57-299d-4f0f-95a2-f9d393e566e2\") " pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:02.954157 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:02.954064 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9213f57-299d-4f0f-95a2-f9d393e566e2-must-gather-output\") pod \"must-gather-b2sv2\" (UID: \"e9213f57-299d-4f0f-95a2-f9d393e566e2\") " pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:03.054788 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:03.054764 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2d5k\" (UniqueName: \"kubernetes.io/projected/e9213f57-299d-4f0f-95a2-f9d393e566e2-kube-api-access-j2d5k\") pod \"must-gather-b2sv2\" (UID: \"e9213f57-299d-4f0f-95a2-f9d393e566e2\") " pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:03.054881 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:03.054794 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9213f57-299d-4f0f-95a2-f9d393e566e2-must-gather-output\") pod \"must-gather-b2sv2\" (UID: \"e9213f57-299d-4f0f-95a2-f9d393e566e2\") " pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:03.055073 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:03.055059 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9213f57-299d-4f0f-95a2-f9d393e566e2-must-gather-output\") pod \"must-gather-b2sv2\" (UID: \"e9213f57-299d-4f0f-95a2-f9d393e566e2\") " pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:03.062482 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:03.062459 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2d5k\" (UniqueName: \"kubernetes.io/projected/e9213f57-299d-4f0f-95a2-f9d393e566e2-kube-api-access-j2d5k\") pod \"must-gather-b2sv2\" (UID: \"e9213f57-299d-4f0f-95a2-f9d393e566e2\") " pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:03.212016 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:03.211948 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:03.335204 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:03.335077 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2nln4/must-gather-b2sv2"] Jul 10 19:48:03.337391 ip-10-0-134-251 kubenswrapper[2555]: W0710 19:48:03.337365 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9213f57_299d_4f0f_95a2_f9d393e566e2.slice/crio-7b5ba53d880e6acfdb7c8d06919a0eb5beec12f1e787ae9d3e3cef712a01230f WatchSource:0}: Error finding container 7b5ba53d880e6acfdb7c8d06919a0eb5beec12f1e787ae9d3e3cef712a01230f: Status 404 returned error can't find the container with id 7b5ba53d880e6acfdb7c8d06919a0eb5beec12f1e787ae9d3e3cef712a01230f Jul 10 19:48:03.339261 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:03.339227 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 19:48:03.425849 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:03.425824 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2nln4/must-gather-b2sv2" event={"ID":"e9213f57-299d-4f0f-95a2-f9d393e566e2","Type":"ContainerStarted","Data":"7b5ba53d880e6acfdb7c8d06919a0eb5beec12f1e787ae9d3e3cef712a01230f"} Jul 10 19:48:10.463486 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:10.463446 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2nln4/must-gather-b2sv2" event={"ID":"e9213f57-299d-4f0f-95a2-f9d393e566e2","Type":"ContainerStarted","Data":"e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612"} Jul 10 19:48:10.463873 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:10.463498 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2nln4/must-gather-b2sv2" event={"ID":"e9213f57-299d-4f0f-95a2-f9d393e566e2","Type":"ContainerStarted","Data":"79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257"} Jul 10 19:48:10.481988 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:10.481937 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2nln4/must-gather-b2sv2" podStartSLOduration=2.486908954 podStartE2EDuration="8.481919379s" totalImagesPullingTime="5.995010425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:48:10.479969541 +0000 UTC m=+3010.232147257" watchObservedRunningTime="2026-07-10 19:48:10.481919379 +0000 UTC m=+3010.234097099" Jul 10 19:48:29.556832 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:29.556798 2555 generic.go:356] "Generic (PLEG): container finished" podID="e9213f57-299d-4f0f-95a2-f9d393e566e2" containerID="e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612" exitCode=0 Jul 10 19:48:29.557374 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:29.556874 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2nln4/must-gather-b2sv2" event={"ID":"e9213f57-299d-4f0f-95a2-f9d393e566e2","Type":"ContainerDied","Data":"e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612"} Jul 10 19:48:29.557374 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:29.557227 2555 scope.go:117] "RemoveContainer" containerID="e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612" Jul 10 19:48:29.590265 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:29.590245 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2nln4_must-gather-b2sv2_e9213f57-299d-4f0f-95a2-f9d393e566e2/gather/0.log" Jul 10 19:48:32.803068 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:32.803039 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xxv9h_6093f54c-d2e1-4752-a781-fec00493f97f/global-pull-secret-syncer/0.log" Jul 10 19:48:32.892844 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:32.892818 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pz6wd_9f2b7dba-e4f5-4c8d-9dc1-3d5871c3ba3a/konnectivity-agent/0.log" Jul 10 19:48:32.981768 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:32.981743 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-251.ec2.internal_ec9137c4307049750dc9b17b99b29ee7/haproxy/0.log" Jul 10 19:48:35.028489 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.028464 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-2nln4/must-gather-b2sv2"] Jul 10 19:48:35.028955 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.028618 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-2nln4/must-gather-b2sv2" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" containerName="copy" containerID="cri-o://79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257" gracePeriod=2 Jul 10 19:48:35.031066 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.031012 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-2nln4/must-gather-b2sv2"] Jul 10 19:48:35.031170 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:48:35.031119 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-b2sv2\" is forbidden: User \"system:node:ip-10-0-134-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2nln4\": no relationship found between node 'ip-10-0-134-251.ec2.internal' and this object" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:35.253072 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.253052 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2nln4_must-gather-b2sv2_e9213f57-299d-4f0f-95a2-f9d393e566e2/copy/0.log" Jul 10 19:48:35.254616 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.254593 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:35.256927 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:48:35.256905 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-b2sv2\" is forbidden: User \"system:node:ip-10-0-134-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2nln4\": no relationship found between node 'ip-10-0-134-251.ec2.internal' and this object" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:35.426360 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.426337 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2d5k\" (UniqueName: \"kubernetes.io/projected/e9213f57-299d-4f0f-95a2-f9d393e566e2-kube-api-access-j2d5k\") pod \"e9213f57-299d-4f0f-95a2-f9d393e566e2\" (UID: \"e9213f57-299d-4f0f-95a2-f9d393e566e2\") " Jul 10 19:48:35.426491 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.426385 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9213f57-299d-4f0f-95a2-f9d393e566e2-must-gather-output\") pod \"e9213f57-299d-4f0f-95a2-f9d393e566e2\" (UID: \"e9213f57-299d-4f0f-95a2-f9d393e566e2\") " Jul 10 19:48:35.427757 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.427733 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9213f57-299d-4f0f-95a2-f9d393e566e2-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "e9213f57-299d-4f0f-95a2-f9d393e566e2" (UID: "e9213f57-299d-4f0f-95a2-f9d393e566e2"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:48:35.428365 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.428339 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9213f57-299d-4f0f-95a2-f9d393e566e2-kube-api-access-j2d5k" (OuterVolumeSpecName: "kube-api-access-j2d5k") pod "e9213f57-299d-4f0f-95a2-f9d393e566e2" (UID: "e9213f57-299d-4f0f-95a2-f9d393e566e2"). InnerVolumeSpecName "kube-api-access-j2d5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:48:35.527082 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.527061 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2d5k\" (UniqueName: \"kubernetes.io/projected/e9213f57-299d-4f0f-95a2-f9d393e566e2-kube-api-access-j2d5k\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:48:35.527082 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.527080 2555 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9213f57-299d-4f0f-95a2-f9d393e566e2-must-gather-output\") on node \"ip-10-0-134-251.ec2.internal\" DevicePath \"\"" Jul 10 19:48:35.581207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.581186 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2nln4_must-gather-b2sv2_e9213f57-299d-4f0f-95a2-f9d393e566e2/copy/0.log" Jul 10 19:48:35.581532 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.581505 2555 generic.go:356] "Generic (PLEG): container finished" podID="e9213f57-299d-4f0f-95a2-f9d393e566e2" containerID="79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257" exitCode=143 Jul 10 19:48:35.581633 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.581558 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:35.581633 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.581585 2555 scope.go:117] "RemoveContainer" containerID="79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257" Jul 10 19:48:35.584138 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:48:35.584108 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-b2sv2\" is forbidden: User \"system:node:ip-10-0-134-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2nln4\": no relationship found between node 'ip-10-0-134-251.ec2.internal' and this object" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:35.589747 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.589729 2555 scope.go:117] "RemoveContainer" containerID="e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612" Jul 10 19:48:35.591880 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:48:35.591859 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-b2sv2\" is forbidden: User \"system:node:ip-10-0-134-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2nln4\": no relationship found between node 'ip-10-0-134-251.ec2.internal' and this object" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" pod="openshift-must-gather-2nln4/must-gather-b2sv2" Jul 10 19:48:35.600912 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.600897 2555 scope.go:117] "RemoveContainer" containerID="79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257" Jul 10 19:48:35.601178 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:48:35.601158 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257\": container with ID starting with 79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257 not found: ID does not exist" containerID="79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257" Jul 10 19:48:35.601225 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.601185 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257"} err="failed to get container status \"79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257\": rpc error: code = NotFound desc = could not find container \"79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257\": container with ID starting with 79140f6342afd2bf03f0ef9e6401ee1a39c0f2a925d236954940f9da49847257 not found: ID does not exist" Jul 10 19:48:35.601225 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.601202 2555 scope.go:117] "RemoveContainer" containerID="e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612" Jul 10 19:48:35.601456 ip-10-0-134-251 kubenswrapper[2555]: E0710 19:48:35.601437 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612\": container with ID starting with e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612 not found: ID does not exist" containerID="e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612" Jul 10 19:48:35.601494 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:35.601462 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612"} err="failed to get container status \"e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612\": rpc error: code = NotFound desc = could not find container \"e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612\": container with ID starting with e48eff7847672ed5f0bb9aaaa3c39d130940aed4ce1fe4333c0890a52ee53612 not found: ID does not exist" Jul 10 19:48:36.719652 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:36.719622 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" path="/var/lib/kubelet/pods/e9213f57-299d-4f0f-95a2-f9d393e566e2/volumes" Jul 10 19:48:36.935018 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:36.934994 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ca647e8-bae9-4ed7-b641-9aefd0fc3464/alertmanager/0.log" Jul 10 19:48:36.965057 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:36.965021 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ca647e8-bae9-4ed7-b641-9aefd0fc3464/config-reloader/0.log" Jul 10 19:48:36.990865 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:36.990846 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ca647e8-bae9-4ed7-b641-9aefd0fc3464/kube-rbac-proxy-web/0.log" Jul 10 19:48:37.015110 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.015090 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ca647e8-bae9-4ed7-b641-9aefd0fc3464/kube-rbac-proxy/0.log" Jul 10 19:48:37.041121 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.041097 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ca647e8-bae9-4ed7-b641-9aefd0fc3464/kube-rbac-proxy-metric/0.log" Jul 10 19:48:37.063939 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.063924 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ca647e8-bae9-4ed7-b641-9aefd0fc3464/prom-label-proxy/0.log" Jul 10 19:48:37.089448 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.089425 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ca647e8-bae9-4ed7-b641-9aefd0fc3464/init-config-reloader/0.log" Jul 10 19:48:37.131326 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.131308 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-b8s7s_cdda9f04-4c6f-4e4f-a8b2-93522e87eea5/cluster-monitoring-operator/0.log" Jul 10 19:48:37.255719 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.255666 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6cf75c4448-97vwj_44b9d14a-35e4-43d9-ab8e-aee7699826f1/metrics-server/0.log" Jul 10 19:48:37.493756 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.493737 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2bxm_b75244c7-75f8-4ce6-8fb9-1a326e9449b8/node-exporter/0.log" Jul 10 19:48:37.517581 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.517532 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2bxm_b75244c7-75f8-4ce6-8fb9-1a326e9449b8/kube-rbac-proxy/0.log" Jul 10 19:48:37.543527 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.543513 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2bxm_b75244c7-75f8-4ce6-8fb9-1a326e9449b8/init-textfile/0.log" Jul 10 19:48:37.576444 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.576427 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fhlrr_5ca0c6f0-d933-4cce-bfed-c37532bca879/kube-rbac-proxy-main/0.log" Jul 10 19:48:37.605078 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.605056 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fhlrr_5ca0c6f0-d933-4cce-bfed-c37532bca879/kube-rbac-proxy-self/0.log" Jul 10 19:48:37.634643 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.634619 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fhlrr_5ca0c6f0-d933-4cce-bfed-c37532bca879/openshift-state-metrics/0.log" Jul 10 19:48:37.687415 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.687397 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7417bb7d-b7c3-4c42-bbfc-d09d419975b7/prometheus/0.log" Jul 10 19:48:37.711867 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.711852 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7417bb7d-b7c3-4c42-bbfc-d09d419975b7/config-reloader/0.log" Jul 10 19:48:37.737191 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.737171 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7417bb7d-b7c3-4c42-bbfc-d09d419975b7/thanos-sidecar/0.log" Jul 10 19:48:37.761436 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.761416 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7417bb7d-b7c3-4c42-bbfc-d09d419975b7/kube-rbac-proxy-web/0.log" Jul 10 19:48:37.790170 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.790124 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7417bb7d-b7c3-4c42-bbfc-d09d419975b7/kube-rbac-proxy/0.log" Jul 10 19:48:37.835066 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.835049 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7417bb7d-b7c3-4c42-bbfc-d09d419975b7/kube-rbac-proxy-thanos/0.log" Jul 10 19:48:37.889879 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:37.889863 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7417bb7d-b7c3-4c42-bbfc-d09d419975b7/init-config-reloader/0.log" Jul 10 19:48:38.080849 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:38.080829 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c99f46c59-tscjl_14c91fb3-802d-4f01-ade8-db47bfaf1fb0/telemeter-client/0.log" Jul 10 19:48:38.113198 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:38.113175 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c99f46c59-tscjl_14c91fb3-802d-4f01-ade8-db47bfaf1fb0/reload/0.log" Jul 10 19:48:38.138226 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:38.138205 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c99f46c59-tscjl_14c91fb3-802d-4f01-ade8-db47bfaf1fb0/kube-rbac-proxy/0.log" Jul 10 19:48:40.470397 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.470369 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84864fc95-7cvdf_c6aaf478-74c6-498d-8266-d75bc175c48b/console/0.log" Jul 10 19:48:40.858736 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.858705 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr"] Jul 10 19:48:40.859013 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.859001 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" containerName="gather" Jul 10 19:48:40.859057 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.859014 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" containerName="gather" Jul 10 19:48:40.859057 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.859021 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" containerName="copy" Jul 10 19:48:40.859057 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.859026 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" containerName="copy" Jul 10 19:48:40.859144 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.859081 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" containerName="gather" Jul 10 19:48:40.859144 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.859090 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9213f57-299d-4f0f-95a2-f9d393e566e2" containerName="copy" Jul 10 19:48:40.862563 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.862539 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:40.865129 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.865107 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fqzzt\"/\"kube-root-ca.crt\"" Jul 10 19:48:40.865244 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.865107 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fqzzt\"/\"default-dockercfg-vr2dg\"" Jul 10 19:48:40.866309 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.866295 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fqzzt\"/\"openshift-service-ca.crt\"" Jul 10 19:48:40.872300 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.872280 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr"] Jul 10 19:48:40.967762 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.967724 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-podres\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:40.967762 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.967770 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-sys\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:40.967952 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.967839 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-proc\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:40.967952 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.967877 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-lib-modules\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:40.967952 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:40.967913 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2pb6\" (UniqueName: \"kubernetes.io/projected/9903f7fd-c697-4da5-ad6f-11bd0559179f-kube-api-access-v2pb6\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.068719 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.068692 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-proc\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.068858 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.068727 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-lib-modules\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.068858 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.068805 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-proc\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.068858 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.068846 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2pb6\" (UniqueName: \"kubernetes.io/projected/9903f7fd-c697-4da5-ad6f-11bd0559179f-kube-api-access-v2pb6\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.068975 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.068894 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-podres\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.068975 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.068853 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-lib-modules\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.068975 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.068921 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-sys\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.068975 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.068962 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-sys\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.069106 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.069049 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9903f7fd-c697-4da5-ad6f-11bd0559179f-podres\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.077372 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.077343 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2pb6\" (UniqueName: \"kubernetes.io/projected/9903f7fd-c697-4da5-ad6f-11bd0559179f-kube-api-access-v2pb6\") pod \"perf-node-gather-daemonset-nm5mr\" (UID: \"9903f7fd-c697-4da5-ad6f-11bd0559179f\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.173158 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.173097 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.294979 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.294911 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr"] Jul 10 19:48:41.297274 ip-10-0-134-251 kubenswrapper[2555]: W0710 19:48:41.297246 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9903f7fd_c697_4da5_ad6f_11bd0559179f.slice/crio-826164e7b46b6c9825ec778eb076f29e4e590e9a68add5f7b8fdb6ff3e9dfba1 WatchSource:0}: Error finding container 826164e7b46b6c9825ec778eb076f29e4e590e9a68add5f7b8fdb6ff3e9dfba1: Status 404 returned error can't find the container with id 826164e7b46b6c9825ec778eb076f29e4e590e9a68add5f7b8fdb6ff3e9dfba1 Jul 10 19:48:41.606246 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.606199 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" event={"ID":"9903f7fd-c697-4da5-ad6f-11bd0559179f","Type":"ContainerStarted","Data":"2eb33d1affc9bb62074e182e78534f35933eaa501aea00bca71788e630bc4b02"} Jul 10 19:48:41.606638 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.606386 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:41.606638 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.606435 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" event={"ID":"9903f7fd-c697-4da5-ad6f-11bd0559179f","Type":"ContainerStarted","Data":"826164e7b46b6c9825ec778eb076f29e4e590e9a68add5f7b8fdb6ff3e9dfba1"} Jul 10 19:48:41.623516 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.623473 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" podStartSLOduration=1.6234578160000002 podStartE2EDuration="1.623457816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:48:41.621928168 +0000 UTC m=+3041.374105888" watchObservedRunningTime="2026-07-10 19:48:41.623457816 +0000 UTC m=+3041.375635534" Jul 10 19:48:41.949418 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.949352 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cb9p4_e07546b0-c428-47db-9643-3301abd4502d/dns/0.log" Jul 10 19:48:41.975759 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:41.975738 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cb9p4_e07546b0-c428-47db-9643-3301abd4502d/kube-rbac-proxy/0.log" Jul 10 19:48:42.135797 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:42.135769 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jfrgv_c3874646-e1df-44b0-9c8d-33ec78921823/dns-node-resolver/0.log" Jul 10 19:48:42.697489 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:42.697462 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hsg7h_85503e38-dcb0-4845-9510-cb8847afef80/node-ca/0.log" Jul 10 19:48:43.977981 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:43.977952 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xlrhj_76648f19-b078-44a3-b39c-f12b7a772c99/serve-healthcheck-canary/0.log" Jul 10 19:48:44.407864 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:44.407828 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdk7n_0589b4ec-92dd-4ae5-a06d-196972da25bd/kube-rbac-proxy/0.log" Jul 10 19:48:44.426606 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:44.426582 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdk7n_0589b4ec-92dd-4ae5-a06d-196972da25bd/exporter/0.log" Jul 10 19:48:44.446200 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:44.446179 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdk7n_0589b4ec-92dd-4ae5-a06d-196972da25bd/extractor/0.log" Jul 10 19:48:46.752884 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:46.752854 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-654w9_c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7/s3-init/0.log" Jul 10 19:48:46.767207 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:46.767179 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-654w9_c5d94ab9-12c5-4dec-803b-e7cb8da9e9c7/download-hf-model/0.log" Jul 10 19:48:47.619650 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:47.619619 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-nm5mr" Jul 10 19:48:51.177602 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:51.177565 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-kttl7_a38b7489-9cbe-4870-8584-baf143e3d918/migrator/0.log" Jul 10 19:48:51.203759 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:51.203697 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-kttl7_a38b7489-9cbe-4870-8584-baf143e3d918/graceful-termination/0.log" Jul 10 19:48:51.535727 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:51.535629 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-p687j_3977581c-775c-498f-ae9a-965374e9d5c4/kube-storage-version-migrator-operator/1.log" Jul 10 19:48:51.536773 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:51.536737 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-p687j_3977581c-775c-498f-ae9a-965374e9d5c4/kube-storage-version-migrator-operator/0.log" Jul 10 19:48:52.882754 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:52.882730 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plnr2_77d94732-b3cb-4630-8b2b-27e916f1e5ea/kube-multus-additional-cni-plugins/0.log" Jul 10 19:48:52.907995 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:52.907971 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plnr2_77d94732-b3cb-4630-8b2b-27e916f1e5ea/egress-router-binary-copy/0.log" Jul 10 19:48:52.931295 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:52.931273 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plnr2_77d94732-b3cb-4630-8b2b-27e916f1e5ea/cni-plugins/0.log" Jul 10 19:48:52.953833 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:52.953810 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plnr2_77d94732-b3cb-4630-8b2b-27e916f1e5ea/bond-cni-plugin/0.log" Jul 10 19:48:52.976162 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:52.976143 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plnr2_77d94732-b3cb-4630-8b2b-27e916f1e5ea/routeoverride-cni/0.log" Jul 10 19:48:53.008978 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:53.008932 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plnr2_77d94732-b3cb-4630-8b2b-27e916f1e5ea/whereabouts-cni-bincopy/0.log" Jul 10 19:48:53.042209 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:53.042193 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plnr2_77d94732-b3cb-4630-8b2b-27e916f1e5ea/whereabouts-cni/0.log" Jul 10 19:48:53.509511 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:53.509487 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gkj7m_2828a377-eaa1-4176-8eba-f01f984857d2/kube-multus/0.log" Jul 10 19:48:53.553468 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:53.553449 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4z4gc_9668ee03-c888-4b72-96a5-f35850c46e12/network-metrics-daemon/0.log" Jul 10 19:48:53.583377 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:53.583360 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4z4gc_9668ee03-c888-4b72-96a5-f35850c46e12/kube-rbac-proxy/0.log" Jul 10 19:48:54.761102 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:54.761066 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-controller/0.log" Jul 10 19:48:54.784124 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:54.784100 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/1.log" Jul 10 19:48:54.784319 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:54.784255 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovn-acl-logging/0.log" Jul 10 19:48:54.809226 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:54.809206 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/kube-rbac-proxy-node/0.log" Jul 10 19:48:54.837650 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:54.837630 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/kube-rbac-proxy-ovn-metrics/0.log" Jul 10 19:48:54.863913 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:54.863895 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/northd/0.log" Jul 10 19:48:54.893416 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:54.893397 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/nbdb/0.log" Jul 10 19:48:54.922974 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:54.922943 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/sbdb/0.log" Jul 10 19:48:54.965105 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:54.965085 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-29w9l_1cac9ee7-9988-4a07-9561-af6ea5ef1f3f/ovnkube-controller/0.log" Jul 10 19:48:56.616929 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:56.616902 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-w4tzb_449560c7-401e-4142-877b-9e5551173711/check-endpoints/0.log" Jul 10 19:48:56.650661 ip-10-0-134-251 kubenswrapper[2555]: I0710 19:48:56.650640 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dsprs_47b6ad13-974c-40f4-872a-473250c868f7/network-check-target-container/0.log"