Sep 15 12:06:18.060143 ip-10-0-133-129 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 15 12:06:18.060153 ip-10-0-133-129 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 15 12:06:18.060161 ip-10-0-133-129 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 15 12:06:18.060389 ip-10-0-133-129 systemd[1]: Failed to start Kubernetes Kubelet. Sep 15 12:06:28.228822 ip-10-0-133-129 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 15 12:06:28.228839 ip-10-0-133-129 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c8731354ab354c4294cc10ab4b54981b -- Sep 15 12:08:25.002183 ip-10-0-133-129 systemd[1]: Starting Kubernetes Kubelet... Sep 15 12:08:25.393585 ip-10-0-133-129 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 12:08:25.393585 ip-10-0-133-129 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 15 12:08:25.393585 ip-10-0-133-129 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 12:08:25.393585 ip-10-0-133-129 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 15 12:08:25.393585 ip-10-0-133-129 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 12:08:25.394566 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.394484 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 15 12:08:25.399697 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399680 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:08:25.399697 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399697 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399701 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399707 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399712 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399716 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399719 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399722 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399725 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399728 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399730 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399733 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399741 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399759 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399763 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399767 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399770 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399773 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399776 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399779 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399782 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:08:25.399777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399785 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399789 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399793 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399797 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399799 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399802 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399805 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399809 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399812 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399815 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399818 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399821 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399825 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399828 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399830 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399833 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399836 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399838 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399840 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:08:25.400373 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399843 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399845 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399848 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399850 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399853 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399856 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399858 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399861 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399863 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399866 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399869 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399871 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399873 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399876 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399878 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399882 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399885 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399887 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399890 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399893 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:08:25.400983 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399895 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399898 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399900 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399903 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399905 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399908 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399910 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399912 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399915 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399918 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399920 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399923 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399925 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399927 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399930 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399932 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399935 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399937 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:08:25.401479 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.399979 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:08:25.402358 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402342 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:08:25.402390 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402358 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:08:25.402390 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402364 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:08:25.402390 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402369 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:08:25.402390 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402374 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:08:25.402390 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402379 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:08:25.402390 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402384 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:08:25.402390 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402389 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402393 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402399 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402404 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402408 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402418 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402423 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402427 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402432 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402436 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402441 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402445 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:08:25.402616 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.402449 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:08:25.403691 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403677 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:08:25.403691 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403690 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403694 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403698 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403701 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403704 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403709 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403713 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403716 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403719 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403722 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403724 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403727 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403730 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403733 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403735 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403738 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403741 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403759 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403762 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403766 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:08:25.403774 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403769 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403772 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403774 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403777 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403780 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403783 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403786 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403789 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403791 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403794 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403797 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403800 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403804 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403808 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403811 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403814 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403817 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403820 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403823 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:08:25.404289 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403825 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403828 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403831 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403834 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403838 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403840 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403843 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403845 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403848 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403850 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403853 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403856 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403859 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403861 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403864 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403867 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403870 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403872 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403875 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403877 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:08:25.404777 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403880 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403883 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403885 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403888 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403890 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403896 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403898 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403900 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403903 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403906 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403909 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403911 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403914 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403916 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403919 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403923 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403925 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403928 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403930 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403933 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:08:25.405276 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403935 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403939 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403942 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403946 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403948 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403951 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403954 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403957 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403960 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403963 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403965 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403968 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403970 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403973 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403976 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403979 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403981 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403990 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.403993 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:08:25.405784 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404905 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404912 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404915 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404918 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404921 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404924 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404927 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404930 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404932 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404935 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404938 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404941 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404943 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404946 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404949 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404953 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404958 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404961 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404964 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404967 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:08:25.406248 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404970 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404972 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404975 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404979 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404982 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404985 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404988 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404991 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404995 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.404998 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405000 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405003 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405006 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405008 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405011 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405013 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405016 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405018 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405021 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405023 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:08:25.406739 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405026 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405028 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405031 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405034 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405038 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405041 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405044 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405047 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405049 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405052 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405055 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405057 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405060 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405063 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405065 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405068 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405070 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405074 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405076 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405079 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:08:25.407237 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405082 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405086 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405088 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405091 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405093 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405096 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405098 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405101 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405103 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405106 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405109 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405112 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405114 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405117 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405119 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405122 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405125 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405127 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405130 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:08:25.407737 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405132 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405135 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405137 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405140 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405143 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405146 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405150 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405153 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405155 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405158 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405161 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405163 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405167 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405169 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405172 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405175 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405178 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405180 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405183 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405185 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:08:25.408220 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405255 2554 flags.go:64] FLAG: --address="0.0.0.0" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405285 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405292 2554 flags.go:64] FLAG: --anonymous-auth="true" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405297 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405301 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405304 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405308 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405313 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405316 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405320 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405323 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405327 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405329 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405332 2554 flags.go:64] FLAG: --cgroup-root="" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405335 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405338 2554 flags.go:64] FLAG: --client-ca-file="" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405341 2554 flags.go:64] FLAG: --cloud-provider="external" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405344 2554 flags.go:64] FLAG: --cluster-dns="[]" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405350 2554 flags.go:64] FLAG: --cluster-domain="" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405353 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405356 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405359 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405362 2554 flags.go:64] FLAG: --container-log-max-files="5" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405370 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 15 12:08:25.408740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405373 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405376 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405379 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405382 2554 flags.go:64] FLAG: --contention-profiling="false" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405386 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405389 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405392 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405395 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405399 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405402 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405405 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405407 2554 flags.go:64] FLAG: --enable-load-reader="false" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405410 2554 flags.go:64] FLAG: --enable-server="true" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405414 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405419 2554 flags.go:64] FLAG: --event-burst="100" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405422 2554 flags.go:64] FLAG: --event-qps="50" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405425 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405428 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405431 2554 flags.go:64] FLAG: --eviction-hard="" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405435 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405437 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405441 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405444 2554 flags.go:64] FLAG: --eviction-soft="" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405447 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405449 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 15 12:08:25.409335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405452 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405457 2554 flags.go:64] FLAG: --experimental-mounter-path="" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405460 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405463 2554 flags.go:64] FLAG: --fail-swap-on="true" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405465 2554 flags.go:64] FLAG: --feature-gates="" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405469 2554 flags.go:64] FLAG: --file-check-frequency="20s" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405472 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405475 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405478 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405481 2554 flags.go:64] FLAG: --healthz-port="10248" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405484 2554 flags.go:64] FLAG: --help="false" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405487 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405491 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405494 2554 flags.go:64] FLAG: --http-check-frequency="20s" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405497 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405500 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405503 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405506 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405509 2554 flags.go:64] FLAG: --image-service-endpoint="" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405512 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405517 2554 flags.go:64] FLAG: --kube-api-burst="100" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405519 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405523 2554 flags.go:64] FLAG: --kube-api-qps="50" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405525 2554 flags.go:64] FLAG: --kube-reserved="" Sep 15 12:08:25.409964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405528 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405531 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405534 2554 flags.go:64] FLAG: --kubelet-cgroups="" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405537 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405540 2554 flags.go:64] FLAG: --lock-file="" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405542 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405545 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405548 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405553 2554 flags.go:64] FLAG: --log-json-split-stream="false" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405557 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405560 2554 flags.go:64] FLAG: --log-text-split-stream="false" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405563 2554 flags.go:64] FLAG: --logging-format="text" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405566 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405569 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405572 2554 flags.go:64] FLAG: --manifest-url="" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405575 2554 flags.go:64] FLAG: --manifest-url-header="" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405579 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405582 2554 flags.go:64] FLAG: --max-open-files="1000000" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405586 2554 flags.go:64] FLAG: --max-pods="110" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405589 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405592 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405595 2554 flags.go:64] FLAG: --memory-manager-policy="None" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405598 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405601 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405604 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 15 12:08:25.410558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405607 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405614 2554 flags.go:64] FLAG: --node-status-max-images="50" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405617 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405622 2554 flags.go:64] FLAG: --oom-score-adj="-999" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405625 2554 flags.go:64] FLAG: --pod-cidr="" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405628 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405634 2554 flags.go:64] FLAG: --pod-manifest-path="" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405637 2554 flags.go:64] FLAG: --pod-max-pids="-1" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405640 2554 flags.go:64] FLAG: --pods-per-core="0" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405643 2554 flags.go:64] FLAG: --port="10250" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405646 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405649 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03e3ab6c70186f5f5" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405652 2554 flags.go:64] FLAG: --qos-reserved="" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405655 2554 flags.go:64] FLAG: --read-only-port="10255" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405658 2554 flags.go:64] FLAG: --register-node="true" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405661 2554 flags.go:64] FLAG: --register-with-taints="" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405666 2554 flags.go:64] FLAG: --registry-burst="10" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405682 2554 flags.go:64] FLAG: --registry-qps="5" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405686 2554 flags.go:64] FLAG: --reserved-cpus="" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405689 2554 flags.go:64] FLAG: --reserved-memory="" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405693 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405696 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405699 2554 flags.go:64] FLAG: --rotate-certificates="false" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405703 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405706 2554 flags.go:64] FLAG: --runonce="false" Sep 15 12:08:25.411191 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405709 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405712 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405715 2554 flags.go:64] FLAG: --seccomp-default="false" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405718 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405721 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405725 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405728 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405731 2554 flags.go:64] FLAG: --storage-driver-password="root" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405734 2554 flags.go:64] FLAG: --storage-driver-secure="false" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405737 2554 flags.go:64] FLAG: --storage-driver-table="stats" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405740 2554 flags.go:64] FLAG: --storage-driver-user="root" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405756 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405760 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405763 2554 flags.go:64] FLAG: --system-cgroups="" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405766 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405772 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405774 2554 flags.go:64] FLAG: --tls-cert-file="" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405777 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405781 2554 flags.go:64] FLAG: --tls-min-version="" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405784 2554 flags.go:64] FLAG: --tls-private-key-file="" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405787 2554 flags.go:64] FLAG: --topology-manager-policy="none" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405790 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405793 2554 flags.go:64] FLAG: --topology-manager-scope="container" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405797 2554 flags.go:64] FLAG: --v="2" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405802 2554 flags.go:64] FLAG: --version="false" Sep 15 12:08:25.411831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405806 2554 flags.go:64] FLAG: --vmodule="" Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405809 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.405812 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405952 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405957 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405960 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405964 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405967 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405970 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405973 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405975 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405978 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405982 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405985 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405988 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405991 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405993 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.405996 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406000 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406003 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:08:25.412514 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406006 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406008 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406011 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406014 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406016 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406019 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406021 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406024 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406027 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406029 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406032 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406035 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406038 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406041 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406044 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406047 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406049 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406052 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406054 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:08:25.413029 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406057 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406060 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406063 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406065 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406067 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406070 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406075 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406078 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406081 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406084 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406087 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406091 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406094 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406096 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406099 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406102 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406105 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406107 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406110 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406112 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:08:25.413504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406115 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406117 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406120 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406123 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406125 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406127 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406130 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406134 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406138 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406141 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406143 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406146 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406148 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406151 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406154 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406156 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406159 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406162 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406164 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:08:25.414009 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406167 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406170 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406173 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406175 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406179 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406182 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406184 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406187 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406189 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406193 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406197 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406200 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406202 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406205 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406208 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406211 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406214 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406216 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406219 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406222 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:08:25.414475 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406224 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406227 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406229 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.406232 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.406858 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.413633 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.413773 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.413794 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.413800 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413859 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413864 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413868 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413871 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413874 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413877 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:08:25.414996 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413880 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413883 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413886 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413889 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413892 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413894 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413897 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413900 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413902 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413905 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413908 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413910 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413913 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413916 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413919 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413921 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413924 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413927 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413930 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413933 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:08:25.415387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413936 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413938 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413941 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413945 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413948 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413950 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413953 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413956 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413959 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413961 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413964 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413968 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413970 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413973 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413976 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413979 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413981 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413984 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413986 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413989 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:08:25.416004 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413992 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413995 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.413997 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414000 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414002 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414006 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414010 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414014 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414017 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414020 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414023 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414026 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414029 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414032 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414035 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414038 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414045 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414048 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414051 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:08:25.416512 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414054 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414057 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414060 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414063 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414065 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414068 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414070 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414073 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414076 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414078 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414081 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414083 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414087 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414091 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414094 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414097 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414100 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414102 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414105 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414107 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:08:25.416990 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414110 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414112 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414115 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414118 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414120 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414124 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414127 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414130 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414133 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414136 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414139 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414142 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414145 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414147 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:08:25.417468 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.414152 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414268 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414274 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414278 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414282 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414286 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414290 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414293 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414296 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414299 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414301 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414304 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414306 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414309 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414312 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414314 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414317 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414320 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414322 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:08:25.417829 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414325 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414328 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414330 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414333 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414335 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414338 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414340 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414343 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414345 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414348 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414351 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414354 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414356 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414359 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414362 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414364 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414367 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414370 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414372 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414375 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:08:25.418298 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414377 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414380 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414382 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414385 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414387 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414390 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414392 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414395 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414397 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414400 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414404 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414407 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414410 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414412 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414415 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414417 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414420 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414422 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414425 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414427 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:08:25.418795 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414430 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414433 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414435 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414438 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414441 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414444 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414446 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414449 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414452 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414454 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414457 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414459 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414462 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414465 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414467 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414470 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414472 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414475 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414478 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:08:25.419279 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414480 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414483 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414486 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414489 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414492 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414494 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414497 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414499 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414502 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414505 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414507 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414510 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414513 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414515 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414519 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414522 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414525 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414528 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414531 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414533 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:08:25.419875 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414536 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:08:25.420391 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:25.414538 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:08:25.420391 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.414543 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 12:08:25.420391 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.414655 2554 server.go:962] "Client rotation is on, will bootstrap in background" Sep 15 12:08:25.420391 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.416611 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 15 12:08:25.420391 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.418494 2554 server.go:1019] "Starting client certificate rotation" Sep 15 12:08:25.420391 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.418594 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 12:08:25.420391 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.418634 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 12:08:25.420983 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.420971 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 12:08:25.425121 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.425105 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 12:08:25.435374 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.435344 2554 log.go:25] "Validated CRI v1 runtime API" Sep 15 12:08:25.438284 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.438265 2554 log.go:25] "Validated CRI v1 image API" Sep 15 12:08:25.439149 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.439133 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 15 12:08:25.445211 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.445182 2554 fs.go:135] Filesystem UUIDs: map[2186310b-50f6-4d19-9787-838d55271912:/dev/nvme0n1p4 71284ed3-4454-4e1d-8dc9-5ba6bcdd321f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 15 12:08:25.445294 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.445209 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 15 12:08:25.447462 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.447441 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 12:08:25.451019 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.450905 2554 manager.go:216] Machine: {Timestamp:2026-09-15 12:08:25.449766707 +0000 UTC m=+0.333961407 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3080321 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cd3db6fafd29f396e57e81f839d95 SystemUUID:ec2cd3db-6faf-d29f-396e-57e81f839d95 BootID:c8731354-ab35-4c42-94cc-10ab4b54981b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e7:70:cc:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e7:70:cc:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:0e:84:d8:3d:1f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 15 12:08:25.451019 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.451011 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 15 12:08:25.451182 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.451164 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 15 12:08:25.452180 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.452157 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 15 12:08:25.452320 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.452181 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-129.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 15 12:08:25.452885 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.452875 2554 topology_manager.go:138] "Creating topology manager with none policy" Sep 15 12:08:25.452922 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.452888 2554 container_manager_linux.go:309] "Creating device plugin manager" Sep 15 12:08:25.452922 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.452897 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 12:08:25.453492 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.453482 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 12:08:25.454304 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.454295 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 15 12:08:25.458111 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.458100 2554 state_mem.go:36] "Initialized new in-memory state store" Sep 15 12:08:25.458225 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.458215 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 15 12:08:25.458255 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.458244 2554 kubelet.go:486] "Attempting to sync node with API server" Sep 15 12:08:25.458255 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.458254 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 15 12:08:25.458316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.458265 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 15 12:08:25.458316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.458274 2554 kubelet.go:398] "Adding apiserver pod source" Sep 15 12:08:25.458316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.458284 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 15 12:08:25.458635 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.458623 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 12:08:25.458635 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.458646 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 12:08:25.461851 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.461832 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 15 12:08:25.464075 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.464061 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 15 12:08:25.464137 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.464092 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 15 12:08:25.466231 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466219 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 15 12:08:25.466273 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466238 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 15 12:08:25.466273 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466245 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 15 12:08:25.466273 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466250 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 15 12:08:25.466273 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466259 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 15 12:08:25.466273 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466265 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 15 12:08:25.466400 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466280 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 15 12:08:25.466400 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466285 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 15 12:08:25.466400 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466293 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 15 12:08:25.466400 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466298 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 15 12:08:25.466400 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466307 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 15 12:08:25.466400 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466312 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 15 12:08:25.466640 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.466620 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 15 12:08:25.466700 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.466666 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 15 12:08:25.466996 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466985 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 15 12:08:25.467037 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.466997 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 15 12:08:25.470448 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.470432 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-129.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 15 12:08:25.470977 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.470963 2554 server.go:1268] "Started kubelet" Sep 15 12:08:25.471034 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.471006 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 15 12:08:25.471148 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.471097 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 15 12:08:25.471187 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.471176 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 15 12:08:25.471832 ip-10-0-133-129 systemd[1]: Started Kubernetes Kubelet. Sep 15 12:08:25.475435 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.475414 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 15 12:08:25.476658 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.476392 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8brt2" Sep 15 12:08:25.477913 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.477772 2554 server.go:310] "Adding debug handlers to kubelet server" Sep 15 12:08:25.479533 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.479503 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 15 12:08:25.479619 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.479541 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8brt2" Sep 15 12:08:25.482683 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.481723 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-129.ec2.internal.18d57d37c75acd47 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-129.ec2.internal,UID:ip-10-0-133-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-129.ec2.internal,},FirstTimestamp:2026-09-15 12:08:25.470930247 +0000 UTC m=+0.355124946,LastTimestamp:2026-09-15 12:08:25.470930247 +0000 UTC m=+0.355124946,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-129.ec2.internal,}" Sep 15 12:08:25.484357 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.484343 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 15 12:08:25.484357 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.484352 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 15 12:08:25.484635 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.484570 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:25.484960 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.484943 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 15 12:08:25.484960 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.484950 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 15 12:08:25.484960 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.484970 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 15 12:08:25.485146 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.485066 2554 reconstruct.go:97] "Volume reconstruction finished" Sep 15 12:08:25.485146 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.485075 2554 reconciler.go:29] "Reconciler: start to sync state" Sep 15 12:08:25.485235 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.485198 2554 factory.go:55] Registering systemd factory Sep 15 12:08:25.485284 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.485236 2554 factory.go:223] Registration of the systemd container factory successfully Sep 15 12:08:25.485510 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.485490 2554 factory.go:153] Registering CRI-O factory Sep 15 12:08:25.485510 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.485508 2554 factory.go:223] Registration of the crio container factory successfully Sep 15 12:08:25.485639 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.485587 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 15 12:08:25.485639 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.485607 2554 factory.go:103] Registering Raw factory Sep 15 12:08:25.485639 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.485619 2554 manager.go:1196] Started watching for new ooms in manager Sep 15 12:08:25.485924 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.485913 2554 manager.go:349] Starting recovery of all containers Sep 15 12:08:25.487888 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.487871 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 12:08:25.491599 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.491575 2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-129.ec2.internal\" not found" node="ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.495108 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.495087 2554 manager.go:354] Recovery completed Sep 15 12:08:25.499646 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.499519 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:08:25.501164 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.501150 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:08:25.501236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.501176 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:08:25.501236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.501187 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:08:25.501718 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.501703 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 15 12:08:25.501718 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.501711 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:08:25.501718 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.501716 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 15 12:08:25.501896 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.501735 2554 state_mem.go:36] "Initialized new in-memory state store" Sep 15 12:08:25.502717 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.502704 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:08:25.502804 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.502729 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:08:25.502804 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.502741 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:08:25.503847 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.503833 2554 policy_none.go:49] "None policy: Start" Sep 15 12:08:25.503917 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.503853 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 15 12:08:25.503917 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.503868 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 15 12:08:25.505817 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.505803 2554 policy_none.go:47] "Start" Sep 15 12:08:25.529588 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.529572 2554 manager.go:337] "Starting Device Plugin manager" Sep 15 12:08:25.529677 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.529607 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 15 12:08:25.529677 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.529617 2554 server.go:87] "Starting device plugin registration server" Sep 15 12:08:25.529908 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.529894 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 15 12:08:25.529977 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.529911 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 15 12:08:25.530040 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.530017 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 15 12:08:25.530100 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.530089 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 15 12:08:25.530147 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.530102 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 15 12:08:25.534080 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.534041 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 15 12:08:25.648913 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.534132 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:25.648913 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.571383 2554 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2588 into the system container \"/system.slice\": " Sep 15 12:08:25.648913 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.630431 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:08:25.648913 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.631468 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:08:25.648913 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.631497 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:08:25.648913 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.631509 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:08:25.648913 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.631540 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.648913 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.639430 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.648913 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.639453 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-129.ec2.internal\": node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:25.659062 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.659043 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:25.722949 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.722917 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 15 12:08:25.724193 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.724169 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 15 12:08:25.724316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.724236 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 15 12:08:25.724316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.724266 2554 kubelet.go:2448] "Starting kubelet main sync loop" Sep 15 12:08:25.724413 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.724315 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 15 12:08:25.726416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.726390 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 12:08:25.759340 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.759315 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:25.824686 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.824659 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal"] Sep 15 12:08:25.824818 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.824770 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:08:25.827228 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.827207 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:08:25.827301 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.827245 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:08:25.827301 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.827256 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:08:25.829571 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.829553 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:08:25.829683 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.829648 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.829683 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.829677 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:08:25.830357 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.830341 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:08:25.830357 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.830344 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:08:25.830483 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.830369 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:08:25.830483 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.830374 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:08:25.830483 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.830382 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:08:25.830483 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.830388 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:08:25.832538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.832518 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.832626 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.832545 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:08:25.833286 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.833268 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:08:25.833365 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.833299 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:08:25.833365 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.833308 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:08:25.859382 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.859362 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:25.859465 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.859445 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-129.ec2.internal\" not found" node="ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.863867 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.863853 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-129.ec2.internal\" not found" node="ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.886285 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.886263 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b57d8508d583b5a5e813c0d523e4fca2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"b57d8508d583b5a5e813c0d523e4fca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.886358 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.886289 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b57d8508d583b5a5e813c0d523e4fca2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"b57d8508d583b5a5e813c0d523e4fca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.886358 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.886306 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21d8db619fc55d5e2c141cfa89e47713-config\") pod \"kube-apiserver-proxy-ip-10-0-133-129.ec2.internal\" (UID: \"21d8db619fc55d5e2c141cfa89e47713\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.959797 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:25.959719 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:25.987372 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.987341 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21d8db619fc55d5e2c141cfa89e47713-config\") pod \"kube-apiserver-proxy-ip-10-0-133-129.ec2.internal\" (UID: \"21d8db619fc55d5e2c141cfa89e47713\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.987448 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.987291 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21d8db619fc55d5e2c141cfa89e47713-config\") pod \"kube-apiserver-proxy-ip-10-0-133-129.ec2.internal\" (UID: \"21d8db619fc55d5e2c141cfa89e47713\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.987448 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.987411 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b57d8508d583b5a5e813c0d523e4fca2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"b57d8508d583b5a5e813c0d523e4fca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.987448 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.987427 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b57d8508d583b5a5e813c0d523e4fca2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"b57d8508d583b5a5e813c0d523e4fca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.987551 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.987482 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b57d8508d583b5a5e813c0d523e4fca2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"b57d8508d583b5a5e813c0d523e4fca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 15 12:08:25.987551 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:25.987523 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b57d8508d583b5a5e813c0d523e4fca2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"b57d8508d583b5a5e813c0d523e4fca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 15 12:08:26.060483 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:26.060457 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:26.166475 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:26.166426 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 15 12:08:26.166475 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:26.166473 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 15 12:08:26.166662 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:26.166446 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:26.267271 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:26.267166 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:26.369797 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:26.369761 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:26.418634 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:26.418601 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 15 12:08:26.419150 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:26.418807 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 12:08:26.419150 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:26.418802 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 12:08:26.469939 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:26.469905 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:26.486593 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:26.486542 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 12:03:26 +0000 UTC" deadline="2028-03-31 14:40:52.873658586 +0000 UTC" Sep 15 12:08:26.486593 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:26.486586 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13514h32m26.387076913s" Sep 15 12:08:26.570875 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:26.570796 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:26.671761 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:26.671702 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:26.772407 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:26.772224 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:26.790351 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:26.790318 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d8db619fc55d5e2c141cfa89e47713.slice/crio-3b10fbd43e5d10c210c67a4333d48844b5a9dd47115ba292661a099b3fd52c1e WatchSource:0}: Error finding container 3b10fbd43e5d10c210c67a4333d48844b5a9dd47115ba292661a099b3fd52c1e: Status 404 returned error can't find the container with id 3b10fbd43e5d10c210c67a4333d48844b5a9dd47115ba292661a099b3fd52c1e Sep 15 12:08:26.796435 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:26.796419 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 12:08:26.798799 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:26.798778 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 12:08:26.877310 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:26.877220 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:26.978711 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:26.978676 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 15 12:08:27.004926 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.004901 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 12:08:27.084675 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.084645 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 15 12:08:27.097705 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.097683 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 12:08:27.099214 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.099199 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 15 12:08:27.107471 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.107451 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 12:08:27.461534 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.461491 2554 apiserver.go:52] "Watching apiserver" Sep 15 12:08:27.469494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.469465 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 15 12:08:27.471809 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.471773 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-6d8vz","kube-system/global-pull-secret-syncer-xqtr5","kube-system/konnectivity-agent-45kq5","openshift-cluster-node-tuning-operator/tuned-mr4g2","openshift-image-registry/node-ca-2t9g8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal","openshift-multus/multus-additional-cni-plugins-s57mq","openshift-multus/network-metrics-daemon-fqj7b","openshift-network-operator/iptables-alerter-78d5v","kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g","openshift-dns/node-resolver-lkncf","openshift-multus/multus-vvzfs","openshift-network-diagnostics/network-check-target-n2jfb"] Sep 15 12:08:27.474430 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.474411 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.476970 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.476747 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.477824 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.477803 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 15 12:08:27.477951 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.477922 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 15 12:08:27.478124 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.478104 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 15 12:08:27.478374 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.478355 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f6dxb\"" Sep 15 12:08:27.478742 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.478719 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 15 12:08:27.479383 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.479362 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:27.479655 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.479632 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 15 12:08:27.480286 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.480264 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 15 12:08:27.480797 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.480743 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8dqpb\"" Sep 15 12:08:27.482369 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.482210 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 15 12:08:27.482490 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.482468 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9wgs6\"" Sep 15 12:08:27.483050 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.482774 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 15 12:08:27.483050 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.483014 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.484616 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.484568 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 15 12:08:27.484950 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.484932 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2t9g8" Sep 15 12:08:27.486187 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.486165 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 15 12:08:27.486296 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.486260 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mbwqm\"" Sep 15 12:08:27.486389 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.486364 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 15 12:08:27.487115 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.487096 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ljdp4\"" Sep 15 12:08:27.487203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.487114 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 15 12:08:27.487203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.487146 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 15 12:08:27.487370 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.487353 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:27.487441 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:27.487420 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:27.487561 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.487541 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 15 12:08:27.489778 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.489742 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-78d5v" Sep 15 12:08:27.492045 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.492020 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 15 12:08:27.492246 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.492228 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 15 12:08:27.492436 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.492417 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.492583 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.492565 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w4fk8\"" Sep 15 12:08:27.493018 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.492874 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 15 12:08:27.495004 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.494983 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 15 12:08:27.495115 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.494996 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:27.495173 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:27.495131 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:27.495272 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.495236 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j6vjz\"" Sep 15 12:08:27.495371 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.495349 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 15 12:08:27.495469 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.495382 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 15 12:08:27.496634 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.496612 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 15 12:08:27.496737 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.496662 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 15 12:08:27.496907 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.496866 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 15 12:08:27.497008 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.496987 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/346a39f9-47a5-48bc-84c9-3365140ca411-cnibin\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.497068 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497027 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-etc-kubernetes\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.497068 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497057 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f022801b-0620-499b-9cec-35f188cd2b18-agent-certs\") pod \"konnectivity-agent-45kq5\" (UID: \"f022801b-0620-499b-9cec-35f188cd2b18\") " pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:27.497145 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497082 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-sysctl-conf\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.497145 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497118 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-sys\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.497236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497150 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/346a39f9-47a5-48bc-84c9-3365140ca411-system-cni-dir\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.497236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497176 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/346a39f9-47a5-48bc-84c9-3365140ca411-cni-binary-copy\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.497236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497217 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/346a39f9-47a5-48bc-84c9-3365140ca411-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.497356 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497242 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-sysconfig\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.497431 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497412 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f524964-795d-40de-b171-5ac191703ccf-host\") pod \"node-ca-2t9g8\" (UID: \"4f524964-795d-40de-b171-5ac191703ccf\") " pod="openshift-image-registry/node-ca-2t9g8" Sep 15 12:08:27.497493 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497445 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rbzk\" (UniqueName: \"kubernetes.io/projected/4f524964-795d-40de-b171-5ac191703ccf-kube-api-access-9rbzk\") pod \"node-ca-2t9g8\" (UID: \"4f524964-795d-40de-b171-5ac191703ccf\") " pod="openshift-image-registry/node-ca-2t9g8" Sep 15 12:08:27.497493 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497486 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-run-netns\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.497598 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497509 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/895e6556-3cac-43f1-9e9f-580024280cd9-tmp\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.497598 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-daemon-config\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.497598 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497562 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/346a39f9-47a5-48bc-84c9-3365140ca411-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.497598 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497589 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktb6d\" (UniqueName: \"kubernetes.io/projected/346a39f9-47a5-48bc-84c9-3365140ca411-kube-api-access-ktb6d\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.497798 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497612 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10c47df8-15f0-449c-98c9-7c930a5c1733-cni-binary-copy\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.497798 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497656 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-socket-dir-parent\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.497798 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497742 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-run-k8s-cni-cncf-io\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.497959 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497782 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-var-lib-cni-multus\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.497959 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497863 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:27.497959 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497866 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-var-lib-kubelet\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.497959 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497921 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-system-cni-dir\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.497959 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:27.497944 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:27.498209 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497955 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-var-lib-cni-bin\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.498209 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.497991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-conf-dir\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.498209 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498016 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f022801b-0620-499b-9cec-35f188cd2b18-konnectivity-ca\") pod \"konnectivity-agent-45kq5\" (UID: \"f022801b-0620-499b-9cec-35f188cd2b18\") " pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:27.498209 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498043 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-kubernetes\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.498209 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498068 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-systemd\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.498209 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498092 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/895e6556-3cac-43f1-9e9f-580024280cd9-etc-tuned\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.498209 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498153 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcjkf\" (UniqueName: \"kubernetes.io/projected/895e6556-3cac-43f1-9e9f-580024280cd9-kube-api-access-gcjkf\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.498209 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498195 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4kgb\" (UniqueName: \"kubernetes.io/projected/10c47df8-15f0-449c-98c9-7c930a5c1733-kube-api-access-k4kgb\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498225 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-modprobe-d\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498252 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-sysctl-d\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498277 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f524964-795d-40de-b171-5ac191703ccf-serviceca\") pod \"node-ca-2t9g8\" (UID: \"4f524964-795d-40de-b171-5ac191703ccf\") " pod="openshift-image-registry/node-ca-2t9g8" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498311 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d74z\" (UniqueName: \"kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z\") pod \"network-check-target-n2jfb\" (UID: \"4faba139-910e-4c25-83b8-41797f237bf8\") " pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498342 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/346a39f9-47a5-48bc-84c9-3365140ca411-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498396 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-run-multus-certs\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498444 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-lib-modules\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498468 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-var-lib-kubelet\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498495 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-cni-dir\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498517 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-cnibin\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-hostroot\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.498595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498591 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-run\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.499221 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.498618 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-host\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.502447 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.500847 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 12:08:27.502447 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.501558 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.503158 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.503136 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lkncf" Sep 15 12:08:27.503983 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.503861 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 15 12:08:27.504075 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.504056 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7bhqz\"" Sep 15 12:08:27.504484 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.504460 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 15 12:08:27.504676 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.504658 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 15 12:08:27.505887 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.505866 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-78q97\"" Sep 15 12:08:27.506108 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.506092 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 15 12:08:27.506315 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.505746 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 15 12:08:27.522771 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.522528 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7gsh8" Sep 15 12:08:27.533428 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.533409 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7gsh8" Sep 15 12:08:27.586135 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.586105 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 15 12:08:27.599098 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599064 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-system-cni-dir\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.599247 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599110 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-kubelet\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.599247 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599138 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-node-log\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.599247 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599164 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz9vb\" (UniqueName: \"kubernetes.io/projected/b7b35aca-f916-427c-a664-c01548bdef0f-kube-api-access-cz9vb\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:27.599247 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f524964-795d-40de-b171-5ac191703ccf-serviceca\") pod \"node-ca-2t9g8\" (UID: \"4f524964-795d-40de-b171-5ac191703ccf\") " pod="openshift-image-registry/node-ca-2t9g8" Sep 15 12:08:27.599247 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599221 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5224c06-9441-4fa1-9e01-bdcad9e209ca-kubelet-config\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:27.599247 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d74z\" (UniqueName: \"kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z\") pod \"network-check-target-n2jfb\" (UID: \"4faba139-910e-4c25-83b8-41797f237bf8\") " pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:27.599494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599262 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-system-cni-dir\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.599494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599271 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/346a39f9-47a5-48bc-84c9-3365140ca411-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.599494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-lib-modules\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.599494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599343 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-var-lib-kubelet\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.599494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599375 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-cni-netd\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.599494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599404 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qwsp\" (UniqueName: \"kubernetes.io/projected/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-kube-api-access-6qwsp\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.599494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599433 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8h2k\" (UniqueName: \"kubernetes.io/projected/d72ef612-fab9-45ed-bac5-1826950a3556-kube-api-access-k8h2k\") pod \"node-resolver-lkncf\" (UID: \"d72ef612-fab9-45ed-bac5-1826950a3556\") " pod="openshift-dns/node-resolver-lkncf" Sep 15 12:08:27.599494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599460 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-cnibin\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.599494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599460 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-lib-modules\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.599494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599471 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/346a39f9-47a5-48bc-84c9-3365140ca411-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.599494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599483 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-host\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599531 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-sysctl-conf\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599540 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-var-lib-kubelet\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599599 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-cnibin\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599610 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-slash\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599646 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-run-openvswitch\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599664 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-host\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599684 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44qsv\" (UniqueName: \"kubernetes.io/projected/d78c5771-0326-4644-9faa-95f66a5f6863-kube-api-access-44qsv\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599711 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-sysctl-conf\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599739 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599761 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f524964-795d-40de-b171-5ac191703ccf-serviceca\") pod \"node-ca-2t9g8\" (UID: \"4f524964-795d-40de-b171-5ac191703ccf\") " pod="openshift-image-registry/node-ca-2t9g8" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599775 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-sys-fs\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/346a39f9-47a5-48bc-84c9-3365140ca411-system-cni-dir\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599827 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/346a39f9-47a5-48bc-84c9-3365140ca411-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599846 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f6e066f-ee71-4484-88e9-2b6fce04d6c4-host-slash\") pod \"iptables-alerter-78d5v\" (UID: \"5f6e066f-ee71-4484-88e9-2b6fce04d6c4\") " pod="openshift-network-operator/iptables-alerter-78d5v" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599864 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-run-systemd\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599898 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5224c06-9441-4fa1-9e01-bdcad9e209ca-dbus\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:27.600086 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599925 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599941 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-device-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d72ef612-fab9-45ed-bac5-1826950a3556-tmp-dir\") pod \"node-resolver-lkncf\" (UID: \"d72ef612-fab9-45ed-bac5-1826950a3556\") " pod="openshift-dns/node-resolver-lkncf" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599978 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/346a39f9-47a5-48bc-84c9-3365140ca411-system-cni-dir\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.599985 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktb6d\" (UniqueName: \"kubernetes.io/projected/346a39f9-47a5-48bc-84c9-3365140ca411-kube-api-access-ktb6d\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600027 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10c47df8-15f0-449c-98c9-7c930a5c1733-cni-binary-copy\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600057 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-socket-dir-parent\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-var-lib-cni-multus\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600106 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-conf-dir\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/895e6556-3cac-43f1-9e9f-580024280cd9-etc-tuned\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-run-ovn-kubernetes\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600189 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600225 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-var-lib-cni-bin\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600250 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f022801b-0620-499b-9cec-35f188cd2b18-konnectivity-ca\") pod \"konnectivity-agent-45kq5\" (UID: \"f022801b-0620-499b-9cec-35f188cd2b18\") " pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600296 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-systemd\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600322 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcjkf\" (UniqueName: \"kubernetes.io/projected/895e6556-3cac-43f1-9e9f-580024280cd9-kube-api-access-gcjkf\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600353 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d78c5771-0326-4644-9faa-95f66a5f6863-env-overrides\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.600814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600379 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600425 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600438 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/346a39f9-47a5-48bc-84c9-3365140ca411-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600450 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d72ef612-fab9-45ed-bac5-1826950a3556-hosts-file\") pod \"node-resolver-lkncf\" (UID: \"d72ef612-fab9-45ed-bac5-1826950a3556\") " pod="openshift-dns/node-resolver-lkncf" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600475 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4kgb\" (UniqueName: \"kubernetes.io/projected/10c47df8-15f0-449c-98c9-7c930a5c1733-kube-api-access-k4kgb\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600502 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-var-lib-cni-bin\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-modprobe-d\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600549 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-conf-dir\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600573 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-sysctl-d\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600607 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-modprobe-d\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600617 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn8ch\" (UniqueName: \"kubernetes.io/projected/5f6e066f-ee71-4484-88e9-2b6fce04d6c4-kube-api-access-tn8ch\") pod \"iptables-alerter-78d5v\" (UID: \"5f6e066f-ee71-4484-88e9-2b6fce04d6c4\") " pod="openshift-network-operator/iptables-alerter-78d5v" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600608 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10c47df8-15f0-449c-98c9-7c930a5c1733-cni-binary-copy\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600643 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-run-netns\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600683 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-socket-dir-parent\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600692 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d78c5771-0326-4644-9faa-95f66a5f6863-ovn-node-metrics-cert\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600825 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-var-lib-cni-multus\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600815 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-run-multus-certs\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.601604 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600870 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-systemd-units\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600893 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d78c5771-0326-4644-9faa-95f66a5f6863-ovnkube-config\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600928 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-sysctl-d\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.600989 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-cni-dir\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601019 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-systemd\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601029 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-hostroot\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601058 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-run-multus-certs\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601082 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-cni-dir\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-run\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601106 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-hostroot\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601140 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-run-ovn\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601147 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-run\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601158 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-socket-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601141 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601214 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-registration-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601246 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-etc-openvswitch\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601281 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/346a39f9-47a5-48bc-84c9-3365140ca411-cnibin\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601309 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-etc-kubernetes\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.602582 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601338 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f022801b-0620-499b-9cec-35f188cd2b18-agent-certs\") pod \"konnectivity-agent-45kq5\" (UID: \"f022801b-0620-499b-9cec-35f188cd2b18\") " pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601350 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-etc-kubernetes\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601361 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-sys\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601389 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-var-lib-openvswitch\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601414 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-sys\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601419 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f022801b-0620-499b-9cec-35f188cd2b18-konnectivity-ca\") pod \"konnectivity-agent-45kq5\" (UID: \"f022801b-0620-499b-9cec-35f188cd2b18\") " pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601416 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/346a39f9-47a5-48bc-84c9-3365140ca411-cni-binary-copy\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601360 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/346a39f9-47a5-48bc-84c9-3365140ca411-cnibin\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-sysconfig\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601486 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f524964-795d-40de-b171-5ac191703ccf-host\") pod \"node-ca-2t9g8\" (UID: \"4f524964-795d-40de-b171-5ac191703ccf\") " pod="openshift-image-registry/node-ca-2t9g8" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601512 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rbzk\" (UniqueName: \"kubernetes.io/projected/4f524964-795d-40de-b171-5ac191703ccf-kube-api-access-9rbzk\") pod \"node-ca-2t9g8\" (UID: \"4f524964-795d-40de-b171-5ac191703ccf\") " pod="openshift-image-registry/node-ca-2t9g8" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601522 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-sysconfig\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f6e066f-ee71-4484-88e9-2b6fce04d6c4-iptables-alerter-script\") pod \"iptables-alerter-78d5v\" (UID: \"5f6e066f-ee71-4484-88e9-2b6fce04d6c4\") " pod="openshift-network-operator/iptables-alerter-78d5v" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601567 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f524964-795d-40de-b171-5ac191703ccf-host\") pod \"node-ca-2t9g8\" (UID: \"4f524964-795d-40de-b171-5ac191703ccf\") " pod="openshift-image-registry/node-ca-2t9g8" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601568 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-cni-bin\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d78c5771-0326-4644-9faa-95f66a5f6863-ovnkube-script-lib\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-run-netns\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601668 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-run-netns\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.603531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601687 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/895e6556-3cac-43f1-9e9f-580024280cd9-tmp\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601721 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-log-socket\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601740 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-daemon-config\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601770 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/346a39f9-47a5-48bc-84c9-3365140ca411-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601827 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-run-k8s-cni-cncf-io\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601880 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/346a39f9-47a5-48bc-84c9-3365140ca411-cni-binary-copy\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601885 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-run-k8s-cni-cncf-io\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-var-lib-kubelet\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601941 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-kubernetes\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601988 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/895e6556-3cac-43f1-9e9f-580024280cd9-etc-kubernetes\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.601944 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10c47df8-15f0-449c-98c9-7c930a5c1733-host-var-lib-kubelet\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.602269 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10c47df8-15f0-449c-98c9-7c930a5c1733-multus-daemon-config\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.604416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.602270 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/346a39f9-47a5-48bc-84c9-3365140ca411-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.605377 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.605360 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/895e6556-3cac-43f1-9e9f-580024280cd9-etc-tuned\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.605438 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.605382 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/895e6556-3cac-43f1-9e9f-580024280cd9-tmp\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.605632 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.605611 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f022801b-0620-499b-9cec-35f188cd2b18-agent-certs\") pod \"konnectivity-agent-45kq5\" (UID: \"f022801b-0620-499b-9cec-35f188cd2b18\") " pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:27.605949 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:27.605934 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:08:27.605994 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:27.605954 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:08:27.605994 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:27.605965 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7d74z for pod openshift-network-diagnostics/network-check-target-n2jfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:27.606095 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:27.606024 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z podName:4faba139-910e-4c25-83b8-41797f237bf8 nodeName:}" failed. No retries permitted until 2026-09-15 12:08:28.106008142 +0000 UTC m=+2.990202831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7d74z" (UniqueName: "kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z") pod "network-check-target-n2jfb" (UID: "4faba139-910e-4c25-83b8-41797f237bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:27.608698 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.608672 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcjkf\" (UniqueName: \"kubernetes.io/projected/895e6556-3cac-43f1-9e9f-580024280cd9-kube-api-access-gcjkf\") pod \"tuned-mr4g2\" (UID: \"895e6556-3cac-43f1-9e9f-580024280cd9\") " pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.609882 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.609862 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktb6d\" (UniqueName: \"kubernetes.io/projected/346a39f9-47a5-48bc-84c9-3365140ca411-kube-api-access-ktb6d\") pod \"multus-additional-cni-plugins-s57mq\" (UID: \"346a39f9-47a5-48bc-84c9-3365140ca411\") " pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.610026 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.610006 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4kgb\" (UniqueName: \"kubernetes.io/projected/10c47df8-15f0-449c-98c9-7c930a5c1733-kube-api-access-k4kgb\") pod \"multus-vvzfs\" (UID: \"10c47df8-15f0-449c-98c9-7c930a5c1733\") " pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.610387 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.610364 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rbzk\" (UniqueName: \"kubernetes.io/projected/4f524964-795d-40de-b171-5ac191703ccf-kube-api-access-9rbzk\") pod \"node-ca-2t9g8\" (UID: \"4f524964-795d-40de-b171-5ac191703ccf\") " pod="openshift-image-registry/node-ca-2t9g8" Sep 15 12:08:27.703026 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.702994 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-var-lib-openvswitch\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703026 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703030 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f6e066f-ee71-4484-88e9-2b6fce04d6c4-iptables-alerter-script\") pod \"iptables-alerter-78d5v\" (UID: \"5f6e066f-ee71-4484-88e9-2b6fce04d6c4\") " pod="openshift-network-operator/iptables-alerter-78d5v" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703047 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-cni-bin\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703063 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d78c5771-0326-4644-9faa-95f66a5f6863-ovnkube-script-lib\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703080 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-log-socket\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703099 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-kubelet\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703118 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-node-log\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703138 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-var-lib-openvswitch\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703161 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-log-socket\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703139 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-cni-bin\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703170 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-node-log\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703201 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-kubelet\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703236 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz9vb\" (UniqueName: \"kubernetes.io/projected/b7b35aca-f916-427c-a664-c01548bdef0f-kube-api-access-cz9vb\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:27.703278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5224c06-9441-4fa1-9e01-bdcad9e209ca-kubelet-config\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703328 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-cni-netd\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qwsp\" (UniqueName: \"kubernetes.io/projected/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-kube-api-access-6qwsp\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8h2k\" (UniqueName: \"kubernetes.io/projected/d72ef612-fab9-45ed-bac5-1826950a3556-kube-api-access-k8h2k\") pod \"node-resolver-lkncf\" (UID: \"d72ef612-fab9-45ed-bac5-1826950a3556\") " pod="openshift-dns/node-resolver-lkncf" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703415 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-slash\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703421 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-cni-netd\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703418 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5224c06-9441-4fa1-9e01-bdcad9e209ca-kubelet-config\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703440 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-run-openvswitch\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703481 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-slash\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44qsv\" (UniqueName: \"kubernetes.io/projected/d78c5771-0326-4644-9faa-95f66a5f6863-kube-api-access-44qsv\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703482 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-run-openvswitch\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703543 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-sys-fs\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703604 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-sys-fs\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:27.703618 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703636 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f6e066f-ee71-4484-88e9-2b6fce04d6c4-host-slash\") pod \"iptables-alerter-78d5v\" (UID: \"5f6e066f-ee71-4484-88e9-2b6fce04d6c4\") " pod="openshift-network-operator/iptables-alerter-78d5v" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-run-systemd\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.703941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703674 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5224c06-9441-4fa1-9e01-bdcad9e209ca-dbus\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:27.703698 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs podName:b7b35aca-f916-427c-a664-c01548bdef0f nodeName:}" failed. No retries permitted until 2026-09-15 12:08:28.203677209 +0000 UTC m=+3.087871898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs") pod "network-metrics-daemon-fqj7b" (UID: "b7b35aca-f916-427c-a664-c01548bdef0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703731 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703727 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f6e066f-ee71-4484-88e9-2b6fce04d6c4-host-slash\") pod \"iptables-alerter-78d5v\" (UID: \"5f6e066f-ee71-4484-88e9-2b6fce04d6c4\") " pod="openshift-network-operator/iptables-alerter-78d5v" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703737 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-run-systemd\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703766 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d78c5771-0326-4644-9faa-95f66a5f6863-ovnkube-script-lib\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703737 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f6e066f-ee71-4484-88e9-2b6fce04d6c4-iptables-alerter-script\") pod \"iptables-alerter-78d5v\" (UID: \"5f6e066f-ee71-4484-88e9-2b6fce04d6c4\") " pod="openshift-network-operator/iptables-alerter-78d5v" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703758 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-device-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:27.703824 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703841 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d72ef612-fab9-45ed-bac5-1826950a3556-tmp-dir\") pod \"node-resolver-lkncf\" (UID: \"d72ef612-fab9-45ed-bac5-1826950a3556\") " pod="openshift-dns/node-resolver-lkncf" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703821 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-device-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:27.703867 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret podName:c5224c06-9441-4fa1-9e01-bdcad9e209ca nodeName:}" failed. No retries permitted until 2026-09-15 12:08:28.203853227 +0000 UTC m=+3.088047915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret") pod "global-pull-secret-syncer-xqtr5" (UID: "c5224c06-9441-4fa1-9e01-bdcad9e209ca") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703803 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5224c06-9441-4fa1-9e01-bdcad9e209ca-dbus\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703908 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-run-ovn-kubernetes\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703926 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703947 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d78c5771-0326-4644-9faa-95f66a5f6863-env-overrides\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.704726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703962 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703977 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703994 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d72ef612-fab9-45ed-bac5-1826950a3556-hosts-file\") pod \"node-resolver-lkncf\" (UID: \"d72ef612-fab9-45ed-bac5-1826950a3556\") " pod="openshift-dns/node-resolver-lkncf" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703990 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.703972 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-run-ovn-kubernetes\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704047 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d72ef612-fab9-45ed-bac5-1826950a3556-hosts-file\") pod \"node-resolver-lkncf\" (UID: \"d72ef612-fab9-45ed-bac5-1826950a3556\") " pod="openshift-dns/node-resolver-lkncf" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704074 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704092 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn8ch\" (UniqueName: \"kubernetes.io/projected/5f6e066f-ee71-4484-88e9-2b6fce04d6c4-kube-api-access-tn8ch\") pod \"iptables-alerter-78d5v\" (UID: \"5f6e066f-ee71-4484-88e9-2b6fce04d6c4\") " pod="openshift-network-operator/iptables-alerter-78d5v" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704092 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704108 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-run-netns\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704123 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d78c5771-0326-4644-9faa-95f66a5f6863-ovn-node-metrics-cert\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704132 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d72ef612-fab9-45ed-bac5-1826950a3556-tmp-dir\") pod \"node-resolver-lkncf\" (UID: \"d72ef612-fab9-45ed-bac5-1826950a3556\") " pod="openshift-dns/node-resolver-lkncf" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704142 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-systemd-units\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704160 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d78c5771-0326-4644-9faa-95f66a5f6863-ovnkube-config\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704178 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-run-ovn\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-socket-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704207 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-registration-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.705269 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-etc-openvswitch\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705863 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704262 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-run-ovn\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705863 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704271 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-host-run-netns\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705863 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704300 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-registration-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.705863 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704319 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-systemd-units\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705863 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704339 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d78c5771-0326-4644-9faa-95f66a5f6863-etc-openvswitch\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705863 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704366 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-socket-dir\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.705863 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704379 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d78c5771-0326-4644-9faa-95f66a5f6863-env-overrides\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.705863 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.704669 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d78c5771-0326-4644-9faa-95f66a5f6863-ovnkube-config\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.706472 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.706455 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d78c5771-0326-4644-9faa-95f66a5f6863-ovn-node-metrics-cert\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.713451 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.713381 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qwsp\" (UniqueName: \"kubernetes.io/projected/ce6b86cb-9fb4-4d8d-8f16-df80be4374ca-kube-api-access-6qwsp\") pod \"aws-ebs-csi-driver-node-hd72g\" (UID: \"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.713581 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.713536 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz9vb\" (UniqueName: \"kubernetes.io/projected/b7b35aca-f916-427c-a664-c01548bdef0f-kube-api-access-cz9vb\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:27.713686 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.713662 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8h2k\" (UniqueName: \"kubernetes.io/projected/d72ef612-fab9-45ed-bac5-1826950a3556-kube-api-access-k8h2k\") pod \"node-resolver-lkncf\" (UID: \"d72ef612-fab9-45ed-bac5-1826950a3556\") " pod="openshift-dns/node-resolver-lkncf" Sep 15 12:08:27.713745 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.713698 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44qsv\" (UniqueName: \"kubernetes.io/projected/d78c5771-0326-4644-9faa-95f66a5f6863-kube-api-access-44qsv\") pod \"ovnkube-node-6d8vz\" (UID: \"d78c5771-0326-4644-9faa-95f66a5f6863\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.714282 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.714264 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn8ch\" (UniqueName: \"kubernetes.io/projected/5f6e066f-ee71-4484-88e9-2b6fce04d6c4-kube-api-access-tn8ch\") pod \"iptables-alerter-78d5v\" (UID: \"5f6e066f-ee71-4484-88e9-2b6fce04d6c4\") " pod="openshift-network-operator/iptables-alerter-78d5v" Sep 15 12:08:27.728937 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.728892 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" event={"ID":"21d8db619fc55d5e2c141cfa89e47713","Type":"ContainerStarted","Data":"3b10fbd43e5d10c210c67a4333d48844b5a9dd47115ba292661a099b3fd52c1e"} Sep 15 12:08:27.732607 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.732589 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 12:08:27.790095 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.790061 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s57mq" Sep 15 12:08:27.797045 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.797025 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvzfs" Sep 15 12:08:27.803516 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:27.803484 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346a39f9_47a5_48bc_84c9_3365140ca411.slice/crio-6a8389b6da76d0da6fee160b752bd9446b1b2ca963dbb8468e994d9fb9aed3f1 WatchSource:0}: Error finding container 6a8389b6da76d0da6fee160b752bd9446b1b2ca963dbb8468e994d9fb9aed3f1: Status 404 returned error can't find the container with id 6a8389b6da76d0da6fee160b752bd9446b1b2ca963dbb8468e994d9fb9aed3f1 Sep 15 12:08:27.805762 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.805721 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:27.809282 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:27.809257 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c47df8_15f0_449c_98c9_7c930a5c1733.slice/crio-db4fdafdb1a67bc0100b1c03408156a9da3a165fafbb1608fd935dc3282d01f9 WatchSource:0}: Error finding container db4fdafdb1a67bc0100b1c03408156a9da3a165fafbb1608fd935dc3282d01f9: Status 404 returned error can't find the container with id db4fdafdb1a67bc0100b1c03408156a9da3a165fafbb1608fd935dc3282d01f9 Sep 15 12:08:27.813525 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.813446 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" Sep 15 12:08:27.815960 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:27.815937 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf022801b_0620_499b_9cec_35f188cd2b18.slice/crio-3f219c413e3ebf55809d2d3c919c24a379a299ea5f98fc5d51b0895df7e0d8cb WatchSource:0}: Error finding container 3f219c413e3ebf55809d2d3c919c24a379a299ea5f98fc5d51b0895df7e0d8cb: Status 404 returned error can't find the container with id 3f219c413e3ebf55809d2d3c919c24a379a299ea5f98fc5d51b0895df7e0d8cb Sep 15 12:08:27.823639 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.823597 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2t9g8" Sep 15 12:08:27.824686 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:27.824661 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895e6556_3cac_43f1_9e9f_580024280cd9.slice/crio-9a1764e66dc52e366f17378a3b9a7a8884362810eab309c808393ac7778c43fb WatchSource:0}: Error finding container 9a1764e66dc52e366f17378a3b9a7a8884362810eab309c808393ac7778c43fb: Status 404 returned error can't find the container with id 9a1764e66dc52e366f17378a3b9a7a8884362810eab309c808393ac7778c43fb Sep 15 12:08:27.833392 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.833370 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-78d5v" Sep 15 12:08:27.840488 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.840468 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:27.847548 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.847518 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" Sep 15 12:08:27.854285 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.854263 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lkncf" Sep 15 12:08:27.883988 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:27.883958 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 12:08:28.106362 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.106280 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d74z\" (UniqueName: \"kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z\") pod \"network-check-target-n2jfb\" (UID: \"4faba139-910e-4c25-83b8-41797f237bf8\") " pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:28.106542 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:28.106434 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:08:28.106542 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:28.106454 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:08:28.106542 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:28.106464 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7d74z for pod openshift-network-diagnostics/network-check-target-n2jfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:28.106542 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:28.106530 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z podName:4faba139-910e-4c25-83b8-41797f237bf8 nodeName:}" failed. No retries permitted until 2026-09-15 12:08:29.106511059 +0000 UTC m=+3.990705753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7d74z" (UniqueName: "kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z") pod "network-check-target-n2jfb" (UID: "4faba139-910e-4c25-83b8-41797f237bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:28.179356 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:28.179322 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f524964_795d_40de_b171_5ac191703ccf.slice/crio-9f0f0de47ad2e1516a1ccdca3e164b64e059abe14b6cb0f85c4aee4fd07c34ef WatchSource:0}: Error finding container 9f0f0de47ad2e1516a1ccdca3e164b64e059abe14b6cb0f85c4aee4fd07c34ef: Status 404 returned error can't find the container with id 9f0f0de47ad2e1516a1ccdca3e164b64e059abe14b6cb0f85c4aee4fd07c34ef Sep 15 12:08:28.207587 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.207544 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:28.207587 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.207579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:28.207857 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:28.207701 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:28.207857 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:28.207772 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs podName:b7b35aca-f916-427c-a664-c01548bdef0f nodeName:}" failed. No retries permitted until 2026-09-15 12:08:29.207743507 +0000 UTC m=+4.091938202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs") pod "network-metrics-daemon-fqj7b" (UID: "b7b35aca-f916-427c-a664-c01548bdef0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:28.207857 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:28.207701 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:28.207857 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:28.207833 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret podName:c5224c06-9441-4fa1-9e01-bdcad9e209ca nodeName:}" failed. No retries permitted until 2026-09-15 12:08:29.207821011 +0000 UTC m=+4.092015699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret") pod "global-pull-secret-syncer-xqtr5" (UID: "c5224c06-9441-4fa1-9e01-bdcad9e209ca") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:28.536985 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.536890 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 12:03:28 +0000 UTC" deadline="2028-06-02 11:34:11.049220306 +0000 UTC" Sep 15 12:08:28.536985 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.536928 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15023h25m42.512295333s" Sep 15 12:08:28.543143 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:28.543116 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6e066f_ee71_4484_88e9_2b6fce04d6c4.slice/crio-654a7bedb21b62ba0a56c97b212f71403d0626d1274dc2168375e47db4469367 WatchSource:0}: Error finding container 654a7bedb21b62ba0a56c97b212f71403d0626d1274dc2168375e47db4469367: Status 404 returned error can't find the container with id 654a7bedb21b62ba0a56c97b212f71403d0626d1274dc2168375e47db4469367 Sep 15 12:08:28.544614 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:28.544586 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72ef612_fab9_45ed_bac5_1826950a3556.slice/crio-baf77af5da672e1c53a804e0e0d732ea8d68cb44012e3449477b15b1b5091ed3 WatchSource:0}: Error finding container baf77af5da672e1c53a804e0e0d732ea8d68cb44012e3449477b15b1b5091ed3: Status 404 returned error can't find the container with id baf77af5da672e1c53a804e0e0d732ea8d68cb44012e3449477b15b1b5091ed3 Sep 15 12:08:28.600387 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:08:28.600357 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb57d8508d583b5a5e813c0d523e4fca2.slice/crio-4c85ab87b09a8f50dd7adc7f20f4057629332898736c834633051faefd342110 WatchSource:0}: Error finding container 4c85ab87b09a8f50dd7adc7f20f4057629332898736c834633051faefd342110: Status 404 returned error can't find the container with id 4c85ab87b09a8f50dd7adc7f20f4057629332898736c834633051faefd342110 Sep 15 12:08:28.733355 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.733302 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2t9g8" event={"ID":"4f524964-795d-40de-b171-5ac191703ccf","Type":"ContainerStarted","Data":"9f0f0de47ad2e1516a1ccdca3e164b64e059abe14b6cb0f85c4aee4fd07c34ef"} Sep 15 12:08:28.735070 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.735032 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lkncf" event={"ID":"d72ef612-fab9-45ed-bac5-1826950a3556","Type":"ContainerStarted","Data":"baf77af5da672e1c53a804e0e0d732ea8d68cb44012e3449477b15b1b5091ed3"} Sep 15 12:08:28.737922 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.737863 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" event={"ID":"895e6556-3cac-43f1-9e9f-580024280cd9","Type":"ContainerStarted","Data":"9a1764e66dc52e366f17378a3b9a7a8884362810eab309c808393ac7778c43fb"} Sep 15 12:08:28.739562 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.739534 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-45kq5" event={"ID":"f022801b-0620-499b-9cec-35f188cd2b18","Type":"ContainerStarted","Data":"3f219c413e3ebf55809d2d3c919c24a379a299ea5f98fc5d51b0895df7e0d8cb"} Sep 15 12:08:28.742022 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.741943 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvzfs" event={"ID":"10c47df8-15f0-449c-98c9-7c930a5c1733","Type":"ContainerStarted","Data":"db4fdafdb1a67bc0100b1c03408156a9da3a165fafbb1608fd935dc3282d01f9"} Sep 15 12:08:28.743414 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.743384 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s57mq" event={"ID":"346a39f9-47a5-48bc-84c9-3365140ca411","Type":"ContainerStarted","Data":"6a8389b6da76d0da6fee160b752bd9446b1b2ca963dbb8468e994d9fb9aed3f1"} Sep 15 12:08:28.746594 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.746527 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" event={"ID":"b57d8508d583b5a5e813c0d523e4fca2","Type":"ContainerStarted","Data":"4c85ab87b09a8f50dd7adc7f20f4057629332898736c834633051faefd342110"} Sep 15 12:08:28.748844 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.748756 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" event={"ID":"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca","Type":"ContainerStarted","Data":"eb0cca93332232b128c82af01c94f53a906a1021e7730ae0a9adf61957f089d1"} Sep 15 12:08:28.750902 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.750875 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" event={"ID":"d78c5771-0326-4644-9faa-95f66a5f6863","Type":"ContainerStarted","Data":"0c2c0173db1d87d201ba97d58b09c8c672d749187bda351853f6315aba1a2e34"} Sep 15 12:08:28.753312 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:28.753244 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-78d5v" event={"ID":"5f6e066f-ee71-4484-88e9-2b6fce04d6c4","Type":"ContainerStarted","Data":"654a7bedb21b62ba0a56c97b212f71403d0626d1274dc2168375e47db4469367"} Sep 15 12:08:29.117421 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:29.117376 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d74z\" (UniqueName: \"kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z\") pod \"network-check-target-n2jfb\" (UID: \"4faba139-910e-4c25-83b8-41797f237bf8\") " pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:29.117625 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:29.117605 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:08:29.117703 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:29.117636 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:08:29.117703 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:29.117652 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7d74z for pod openshift-network-diagnostics/network-check-target-n2jfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:29.117851 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:29.117717 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z podName:4faba139-910e-4c25-83b8-41797f237bf8 nodeName:}" failed. No retries permitted until 2026-09-15 12:08:31.117696434 +0000 UTC m=+6.001891129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7d74z" (UniqueName: "kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z") pod "network-check-target-n2jfb" (UID: "4faba139-910e-4c25-83b8-41797f237bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:29.218619 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:29.218576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:29.218843 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:29.218635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:29.218843 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:29.218808 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:29.218971 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:29.218883 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret podName:c5224c06-9441-4fa1-9e01-bdcad9e209ca nodeName:}" failed. No retries permitted until 2026-09-15 12:08:31.218868187 +0000 UTC m=+6.103062893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret") pod "global-pull-secret-syncer-xqtr5" (UID: "c5224c06-9441-4fa1-9e01-bdcad9e209ca") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:29.219203 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:29.219186 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:29.219283 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:29.219225 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs podName:b7b35aca-f916-427c-a664-c01548bdef0f nodeName:}" failed. No retries permitted until 2026-09-15 12:08:31.219213595 +0000 UTC m=+6.103408284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs") pod "network-metrics-daemon-fqj7b" (UID: "b7b35aca-f916-427c-a664-c01548bdef0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:29.537969 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:29.537853 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 12:03:28 +0000 UTC" deadline="2028-02-26 11:55:01.787818168 +0000 UTC" Sep 15 12:08:29.537969 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:29.537923 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12695h46m32.249899862s" Sep 15 12:08:29.727014 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:29.726956 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:29.727014 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:29.726986 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:29.727271 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:29.726969 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:29.727271 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:29.727108 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:29.727271 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:29.727229 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:29.727528 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:29.727316 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:29.765136 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:29.765093 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" event={"ID":"21d8db619fc55d5e2c141cfa89e47713","Type":"ContainerStarted","Data":"b2b984adbc9c402a0f193c5028ff1931a4bb720ec56819abce804869a0bf7491"} Sep 15 12:08:29.781287 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:29.781221 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" podStartSLOduration=2.781197327 podStartE2EDuration="2.781197327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:08:29.780482672 +0000 UTC m=+4.664677389" watchObservedRunningTime="2026-09-15 12:08:29.781197327 +0000 UTC m=+4.665392042" Sep 15 12:08:31.138520 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:31.137795 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d74z\" (UniqueName: \"kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z\") pod \"network-check-target-n2jfb\" (UID: \"4faba139-910e-4c25-83b8-41797f237bf8\") " pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:31.138520 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:31.138022 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:08:31.138520 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:31.138048 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:08:31.138520 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:31.138062 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7d74z for pod openshift-network-diagnostics/network-check-target-n2jfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:31.138520 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:31.138133 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z podName:4faba139-910e-4c25-83b8-41797f237bf8 nodeName:}" failed. No retries permitted until 2026-09-15 12:08:35.138113677 +0000 UTC m=+10.022308371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7d74z" (UniqueName: "kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z") pod "network-check-target-n2jfb" (UID: "4faba139-910e-4c25-83b8-41797f237bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:31.239348 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:31.238496 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:31.239348 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:31.238557 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:31.239348 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:31.238693 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:31.239348 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:31.238761 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret podName:c5224c06-9441-4fa1-9e01-bdcad9e209ca nodeName:}" failed. No retries permitted until 2026-09-15 12:08:35.238742878 +0000 UTC m=+10.122937573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret") pod "global-pull-secret-syncer-xqtr5" (UID: "c5224c06-9441-4fa1-9e01-bdcad9e209ca") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:31.239348 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:31.239213 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:31.239348 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:31.239264 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs podName:b7b35aca-f916-427c-a664-c01548bdef0f nodeName:}" failed. No retries permitted until 2026-09-15 12:08:35.239248991 +0000 UTC m=+10.123443683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs") pod "network-metrics-daemon-fqj7b" (UID: "b7b35aca-f916-427c-a664-c01548bdef0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:31.724977 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:31.724890 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:31.724977 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:31.724921 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:31.725223 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:31.725025 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:31.725444 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:31.724900 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:31.725444 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:31.725390 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:31.725601 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:31.725463 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:33.725100 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:33.725059 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:33.725596 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:33.725194 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:33.725596 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:33.725196 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:33.725596 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:33.725307 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:33.725596 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:33.725399 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:33.725596 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:33.725472 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:35.171627 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:35.171591 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d74z\" (UniqueName: \"kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z\") pod \"network-check-target-n2jfb\" (UID: \"4faba139-910e-4c25-83b8-41797f237bf8\") " pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:35.172172 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:35.171865 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:08:35.172172 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:35.171891 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:08:35.172172 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:35.171905 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7d74z for pod openshift-network-diagnostics/network-check-target-n2jfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:35.172172 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:35.171972 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z podName:4faba139-910e-4c25-83b8-41797f237bf8 nodeName:}" failed. No retries permitted until 2026-09-15 12:08:43.17195117 +0000 UTC m=+18.056145877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7d74z" (UniqueName: "kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z") pod "network-check-target-n2jfb" (UID: "4faba139-910e-4c25-83b8-41797f237bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:35.272870 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:35.272573 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:35.272870 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:35.272631 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:35.272870 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:35.272766 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:35.272870 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:35.272798 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:35.272870 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:35.272849 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs podName:b7b35aca-f916-427c-a664-c01548bdef0f nodeName:}" failed. No retries permitted until 2026-09-15 12:08:43.272827085 +0000 UTC m=+18.157021778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs") pod "network-metrics-daemon-fqj7b" (UID: "b7b35aca-f916-427c-a664-c01548bdef0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:35.272870 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:35.272872 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret podName:c5224c06-9441-4fa1-9e01-bdcad9e209ca nodeName:}" failed. No retries permitted until 2026-09-15 12:08:43.272860447 +0000 UTC m=+18.157055141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret") pod "global-pull-secret-syncer-xqtr5" (UID: "c5224c06-9441-4fa1-9e01-bdcad9e209ca") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:35.726078 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:35.726036 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:35.726252 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:35.726142 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:35.726687 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:35.726388 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:35.726687 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:35.726507 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:35.726687 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:35.726551 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:35.726687 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:35.726617 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:37.725336 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:37.725150 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:37.725336 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:37.725162 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:37.725336 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:37.725276 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:37.725336 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:37.725285 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:37.726005 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:37.725387 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:37.726005 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:37.725482 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:39.724606 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:39.724577 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:39.725064 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:39.724578 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:39.725064 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:39.724708 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:39.725064 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:39.724578 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:39.725064 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:39.724835 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:39.725064 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:39.724908 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:41.725061 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:41.724866 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:41.725495 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:41.724866 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:41.725495 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:41.725173 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:41.725495 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:41.724866 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:41.725495 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:41.725262 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:41.725495 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:41.725369 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:43.228595 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:43.228520 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d74z\" (UniqueName: \"kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z\") pod \"network-check-target-n2jfb\" (UID: \"4faba139-910e-4c25-83b8-41797f237bf8\") " pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:43.229073 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:43.228649 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:08:43.229073 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:43.228664 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:08:43.229073 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:43.228676 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7d74z for pod openshift-network-diagnostics/network-check-target-n2jfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:43.229073 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:43.228730 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z podName:4faba139-910e-4c25-83b8-41797f237bf8 nodeName:}" failed. No retries permitted until 2026-09-15 12:08:59.228715391 +0000 UTC m=+34.112910079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7d74z" (UniqueName: "kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z") pod "network-check-target-n2jfb" (UID: "4faba139-910e-4c25-83b8-41797f237bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:43.328918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:43.328884 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:43.329075 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:43.328932 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:43.329075 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:43.329048 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:43.329075 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:43.329049 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:43.329255 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:43.329108 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret podName:c5224c06-9441-4fa1-9e01-bdcad9e209ca nodeName:}" failed. No retries permitted until 2026-09-15 12:08:59.329091288 +0000 UTC m=+34.213285975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret") pod "global-pull-secret-syncer-xqtr5" (UID: "c5224c06-9441-4fa1-9e01-bdcad9e209ca") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:43.329255 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:43.329140 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs podName:b7b35aca-f916-427c-a664-c01548bdef0f nodeName:}" failed. No retries permitted until 2026-09-15 12:08:59.329128537 +0000 UTC m=+34.213323227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs") pod "network-metrics-daemon-fqj7b" (UID: "b7b35aca-f916-427c-a664-c01548bdef0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:43.725361 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:43.725247 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:43.725361 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:43.725281 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:43.725361 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:43.725247 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:43.725624 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:43.725374 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:43.725624 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:43.725415 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:43.725624 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:43.725490 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:45.726142 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:45.726097 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:45.726586 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:45.726185 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:45.726586 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:45.726206 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:45.726586 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:45.726318 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:45.726586 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:45.726352 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:45.726586 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:45.726450 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:46.825876 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:46.825843 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" event={"ID":"895e6556-3cac-43f1-9e9f-580024280cd9","Type":"ContainerStarted","Data":"6f0f879d24ebc6d1bd462054ace851fa08d8c69db593315c3d1f64c9b5aa113c"} Sep 15 12:08:46.844724 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:46.844667 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mr4g2" podStartSLOduration=2.03785895 podStartE2EDuration="20.844645396s" totalImagesPullingTime="18.806786446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:08:46.843973742 +0000 UTC m=+21.728168451" watchObservedRunningTime="2026-09-15 12:08:46.844645396 +0000 UTC m=+21.728840106" Sep 15 12:08:47.725177 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.724970 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:47.725359 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.724971 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:47.725359 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:47.725287 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:47.725474 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:47.725408 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:47.725474 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.725077 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:47.725600 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:47.725575 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:47.829307 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.829262 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2t9g8" event={"ID":"4f524964-795d-40de-b171-5ac191703ccf","Type":"ContainerStarted","Data":"a7ee3b6449211830086bdc1d56f15304c3d0681650ec6228c6036935ac9784c4"} Sep 15 12:08:47.831034 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.831004 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lkncf" event={"ID":"d72ef612-fab9-45ed-bac5-1826950a3556","Type":"ContainerStarted","Data":"7b40d6003cf925e240dff3f4a9fee732a56698af09c9c3e6402b780f7a243989"} Sep 15 12:08:47.833049 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.832729 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-45kq5" event={"ID":"f022801b-0620-499b-9cec-35f188cd2b18","Type":"ContainerStarted","Data":"d1c2a456c83ac1cfbad5b44eda77f7a815539c0a9aa7cce63cd7318df7fc0707"} Sep 15 12:08:47.834432 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.834394 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvzfs" event={"ID":"10c47df8-15f0-449c-98c9-7c930a5c1733","Type":"ContainerStarted","Data":"c368013b44b2a542d2e431099e5d305acb19464dc51b2f7ac30ede6a83cf8dc8"} Sep 15 12:08:47.836053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.836029 2554 generic.go:356] "Generic (PLEG): container finished" podID="346a39f9-47a5-48bc-84c9-3365140ca411" containerID="4c110cdc0e7c67bb0a1c35243f1060242dab94b0c1e55a204a1497d15febd128" exitCode=0 Sep 15 12:08:47.836153 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.836057 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s57mq" event={"ID":"346a39f9-47a5-48bc-84c9-3365140ca411","Type":"ContainerDied","Data":"4c110cdc0e7c67bb0a1c35243f1060242dab94b0c1e55a204a1497d15febd128"} Sep 15 12:08:47.837867 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.837846 2554 generic.go:356] "Generic (PLEG): container finished" podID="b57d8508d583b5a5e813c0d523e4fca2" containerID="8be188406c1b1d23dbc213cfb55dc2622e9d70ab9d1df9843727eb39254f411d" exitCode=0 Sep 15 12:08:47.837948 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.837930 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" event={"ID":"b57d8508d583b5a5e813c0d523e4fca2","Type":"ContainerDied","Data":"8be188406c1b1d23dbc213cfb55dc2622e9d70ab9d1df9843727eb39254f411d"} Sep 15 12:08:47.840036 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.840015 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" event={"ID":"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca","Type":"ContainerStarted","Data":"11b5a37493355d6bc7338a6a773b2a7138917ba65d3fd2f0a4b20fb50c95d6aa"} Sep 15 12:08:47.843495 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.843470 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" event={"ID":"d78c5771-0326-4644-9faa-95f66a5f6863","Type":"ContainerStarted","Data":"b82625d92e11f65c2899a60ad06baefd8f301b3324437067196dd0aea19b2501"} Sep 15 12:08:47.843612 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.843546 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" event={"ID":"d78c5771-0326-4644-9faa-95f66a5f6863","Type":"ContainerStarted","Data":"726c419f57275fe245c656088b77da0a3a8bba8f5f6599671e1d86802b961423"} Sep 15 12:08:47.843612 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.843607 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" event={"ID":"d78c5771-0326-4644-9faa-95f66a5f6863","Type":"ContainerStarted","Data":"b09ec3e5c83d874a3f63da47f9de1b455e9c77bcca82f6e47540a4b5df1129eb"} Sep 15 12:08:47.843732 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.843656 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" event={"ID":"d78c5771-0326-4644-9faa-95f66a5f6863","Type":"ContainerStarted","Data":"12824cf0f006d0450b4d68950e33a62e484ed3dc8be140763263462d7f44865d"} Sep 15 12:08:47.843732 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.843705 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" event={"ID":"d78c5771-0326-4644-9faa-95f66a5f6863","Type":"ContainerStarted","Data":"c4115d9d9fedadca2cd57eb496a42597cdd84cd8922a35f8b626d5217edcf557"} Sep 15 12:08:47.843852 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.843771 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" event={"ID":"d78c5771-0326-4644-9faa-95f66a5f6863","Type":"ContainerStarted","Data":"fcac6a3d0e1e448cfa647618a77e4e96211ec27593110c4ab3ec03ebcb430d22"} Sep 15 12:08:47.844094 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.844046 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2t9g8" podStartSLOduration=3.548242462 podStartE2EDuration="21.844028761s" totalImagesPullingTime="18.295786299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:08:47.843333307 +0000 UTC m=+22.727528015" watchObservedRunningTime="2026-09-15 12:08:47.844028761 +0000 UTC m=+22.728223855" Sep 15 12:08:47.862517 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.862478 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lkncf" podStartSLOduration=3.931457116 podStartE2EDuration="21.862464474s" totalImagesPullingTime="17.931007358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:08:47.862255053 +0000 UTC m=+22.746449762" watchObservedRunningTime="2026-09-15 12:08:47.862464474 +0000 UTC m=+22.746659183" Sep 15 12:08:47.912357 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:47.912274 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vvzfs" podStartSLOduration=2.93939413 podStartE2EDuration="21.912258465s" totalImagesPullingTime="18.972864335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:08:47.911435724 +0000 UTC m=+22.795630435" watchObservedRunningTime="2026-09-15 12:08:47.912258465 +0000 UTC m=+22.796453174" Sep 15 12:08:48.041528 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.041299 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:48.152491 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.152462 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:48.187470 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.187448 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 15 12:08:48.253884 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.253853 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:48.353349 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.353317 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:48.546899 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.546734 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T12:08:48.187466891Z","UUID":"c2dee40b-00c7-4301-b452-b29bafb192fd","Handler":null,"Name":"","Endpoint":""} Sep 15 12:08:48.548453 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.548427 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 15 12:08:48.548453 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.548460 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 15 12:08:48.748764 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.748711 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:48.847067 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.846980 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-78d5v" event={"ID":"5f6e066f-ee71-4484-88e9-2b6fce04d6c4","Type":"ContainerStarted","Data":"91aa40d7050f0c4c4b5fe4cda5d9d7d13dfafbea3ef3843f45afe7a55ac4b0a9"} Sep 15 12:08:48.848913 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.848888 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" event={"ID":"b57d8508d583b5a5e813c0d523e4fca2","Type":"ContainerStarted","Data":"a7392b81ca629246ae9812e643408d2545f12809da1682b5aad8813132a3d575"} Sep 15 12:08:48.849967 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.849941 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:48.850701 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.850667 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" event={"ID":"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca","Type":"ContainerStarted","Data":"28af6b16f453f08a84dac860b7ae964aeee544237a218ae8c14d3bda3092baf2"} Sep 15 12:08:48.862451 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.862405 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-78d5v" podStartSLOduration=4.7676967 podStartE2EDuration="22.862389279s" totalImagesPullingTime="18.094692579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:08:48.862339852 +0000 UTC m=+23.746534560" watchObservedRunningTime="2026-09-15 12:08:48.862389279 +0000 UTC m=+23.746583991" Sep 15 12:08:48.863006 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.862962 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-45kq5" podStartSLOduration=7.826509118 podStartE2EDuration="22.862950337s" totalImagesPullingTime="15.036441219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:08:47.926287331 +0000 UTC m=+22.810482045" watchObservedRunningTime="2026-09-15 12:08:48.862950337 +0000 UTC m=+23.747145047" Sep 15 12:08:48.877404 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.877364 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" podStartSLOduration=21.877351691 podStartE2EDuration="21.877351691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:08:48.87694109 +0000 UTC m=+23.761135799" watchObservedRunningTime="2026-09-15 12:08:48.877351691 +0000 UTC m=+23.761546400" Sep 15 12:08:48.915987 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:48.915958 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:49.008028 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:49.007990 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:49.364040 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:49.364013 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:49.705095 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:49.705069 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:49.725156 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:49.725128 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:49.725315 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:49.725251 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:49.725315 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:49.725250 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:49.725315 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:49.725315 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:49.725457 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:49.725398 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:49.725532 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:49.725500 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:49.803787 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:49.803760 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:49.854417 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:49.854385 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" event={"ID":"ce6b86cb-9fb4-4d8d-8f16-df80be4374ca","Type":"ContainerStarted","Data":"934d6cdf84be9c0f66ac04c69191db43a3674f48b0d05fe346cf63a608c9ea97"} Sep 15 12:08:49.857995 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:49.857968 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" event={"ID":"d78c5771-0326-4644-9faa-95f66a5f6863","Type":"ContainerStarted","Data":"9de230666ac63cd8aae20552067d6d3e65413a8d0fb6454633b6654df6b041a1"} Sep 15 12:08:49.875168 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:49.875111 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hd72g" podStartSLOduration=3.97376758 podStartE2EDuration="23.875098214s" totalImagesPullingTime="19.901330634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:08:49.872390572 +0000 UTC m=+24.756585279" watchObservedRunningTime="2026-09-15 12:08:49.875098214 +0000 UTC m=+24.759292954" Sep 15 12:08:49.955401 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:49.955330 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:50.259002 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:50.258910 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:50.259564 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:50.259539 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:50.352933 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:50.352900 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:50.702791 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:50.702742 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:50.803929 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:50.803876 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:50.860671 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:50.860642 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:50.861113 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:50.861052 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-45kq5" Sep 15 12:08:51.725278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:51.725038 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:51.725436 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:51.725394 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:51.725436 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:51.725105 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:51.725556 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:51.725501 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:51.725556 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:51.725080 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:51.725660 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:51.725576 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:51.866727 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:51.866643 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" event={"ID":"d78c5771-0326-4644-9faa-95f66a5f6863","Type":"ContainerStarted","Data":"04f51fb0b4fff69a28e7825171061fc59388cd476f32869de7cfaba27258cf0e"} Sep 15 12:08:51.895508 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:51.895448 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" podStartSLOduration=7.789147735 podStartE2EDuration="25.895433198s" totalImagesPullingTime="18.106285463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:08:51.894618707 +0000 UTC m=+26.778813415" watchObservedRunningTime="2026-09-15 12:08:51.895433198 +0000 UTC m=+26.779627906" Sep 15 12:08:52.869306 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:52.869280 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 15 12:08:52.869871 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:52.869755 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:52.869871 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:52.869836 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:52.885828 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:52.885799 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:52.885957 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:52.885943 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:53.724694 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:53.724660 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:53.724694 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:53.724697 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:53.724956 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:53.724660 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:53.724956 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:53.724814 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:53.724956 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:53.724929 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:53.725053 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:53.725000 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:53.881021 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:53.880992 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 15 12:08:54.875178 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:54.875148 2554 generic.go:356] "Generic (PLEG): container finished" podID="346a39f9-47a5-48bc-84c9-3365140ca411" containerID="03c2bb43fa71c8498f9196216fef637d6391c96f68b314d21de9fe6fedd767b3" exitCode=0 Sep 15 12:08:54.875381 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:54.875229 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s57mq" event={"ID":"346a39f9-47a5-48bc-84c9-3365140ca411","Type":"ContainerDied","Data":"03c2bb43fa71c8498f9196216fef637d6391c96f68b314d21de9fe6fedd767b3"} Sep 15 12:08:54.875381 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:54.875284 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 15 12:08:55.449951 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:55.449910 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:55.726394 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:55.726356 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:55.726545 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:55.726448 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:55.726545 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:55.726492 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:55.726545 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:55.726483 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:55.726645 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:55.726578 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:55.726682 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:55.726651 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:56.008457 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:56.008371 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:08:56.008624 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:56.008572 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 15 12:08:56.025322 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:56.025285 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" podUID="d78c5771-0326-4644-9faa-95f66a5f6863" containerName="ovnkube-controller" probeResult="failure" output="" Sep 15 12:08:56.033561 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:56.033524 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" podUID="d78c5771-0326-4644-9faa-95f66a5f6863" containerName="ovnkube-controller" probeResult="failure" output="" Sep 15 12:08:56.881158 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:56.881128 2554 generic.go:356] "Generic (PLEG): container finished" podID="346a39f9-47a5-48bc-84c9-3365140ca411" containerID="2fd5f3680c4da7237ebe01ca66554e29f7ca5dd1987db5404a24fef4744030fe" exitCode=0 Sep 15 12:08:56.881645 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:56.881185 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s57mq" event={"ID":"346a39f9-47a5-48bc-84c9-3365140ca411","Type":"ContainerDied","Data":"2fd5f3680c4da7237ebe01ca66554e29f7ca5dd1987db5404a24fef4744030fe"} Sep 15 12:08:57.655387 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:57.655354 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:57.708618 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:57.708586 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:08:57.724639 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:57.724617 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:57.724818 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:57.724762 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:57.724893 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:57.724824 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:57.724960 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:57.724939 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:57.725013 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:57.724993 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:57.725127 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:57.725108 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:08:58.887292 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:58.887259 2554 generic.go:356] "Generic (PLEG): container finished" podID="346a39f9-47a5-48bc-84c9-3365140ca411" containerID="4a1f958b6dc6f8ee35ce0a8c6b74a8e134d83605886c760c892c81e75ccfe519" exitCode=0 Sep 15 12:08:58.887662 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:58.887321 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s57mq" event={"ID":"346a39f9-47a5-48bc-84c9-3365140ca411","Type":"ContainerDied","Data":"4a1f958b6dc6f8ee35ce0a8c6b74a8e134d83605886c760c892c81e75ccfe519"} Sep 15 12:08:59.239104 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:59.239068 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d74z\" (UniqueName: \"kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z\") pod \"network-check-target-n2jfb\" (UID: \"4faba139-910e-4c25-83b8-41797f237bf8\") " pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:59.239292 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:59.239231 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:08:59.239292 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:59.239256 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:08:59.239292 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:59.239269 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7d74z for pod openshift-network-diagnostics/network-check-target-n2jfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:59.239453 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:59.239333 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z podName:4faba139-910e-4c25-83b8-41797f237bf8 nodeName:}" failed. No retries permitted until 2026-09-15 12:09:31.239314176 +0000 UTC m=+66.123508865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7d74z" (UniqueName: "kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z") pod "network-check-target-n2jfb" (UID: "4faba139-910e-4c25-83b8-41797f237bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:08:59.340143 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:59.340117 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:59.340143 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:59.340147 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:59.340308 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:59.340240 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:59.340308 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:59.340255 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:59.340308 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:59.340286 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret podName:c5224c06-9441-4fa1-9e01-bdcad9e209ca nodeName:}" failed. No retries permitted until 2026-09-15 12:09:31.340273192 +0000 UTC m=+66.224467879 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret") pod "global-pull-secret-syncer-xqtr5" (UID: "c5224c06-9441-4fa1-9e01-bdcad9e209ca") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:08:59.340308 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:59.340298 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs podName:b7b35aca-f916-427c-a664-c01548bdef0f nodeName:}" failed. No retries permitted until 2026-09-15 12:09:31.340292323 +0000 UTC m=+66.224487011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs") pod "network-metrics-daemon-fqj7b" (UID: "b7b35aca-f916-427c-a664-c01548bdef0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:08:59.725445 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:59.725409 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:08:59.725602 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:59.725409 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:08:59.725602 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:08:59.725541 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:08:59.725602 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:59.725543 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:08:59.725720 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:59.725617 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:08:59.725720 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:08:59.725688 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:09:00.070446 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:00.070366 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:01.584361 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:01.584173 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2jfb"] Sep 15 12:09:01.584872 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:01.584501 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:09:01.584872 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:01.584616 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:09:01.586976 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:01.586952 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fqj7b"] Sep 15 12:09:01.587143 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:01.587065 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:09:01.587227 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:01.587166 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:09:01.598383 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:01.598281 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xqtr5"] Sep 15 12:09:01.598556 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:01.598473 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:09:01.598620 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:01.598574 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:09:01.854833 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:01.854794 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:01.967354 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:01.967329 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:02.077474 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:02.077431 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:02.725054 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:02.725024 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:09:02.725504 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:02.725023 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:09:02.725504 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:02.725158 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:09:02.725504 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:02.725259 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:09:03.343007 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:03.342976 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:03.725350 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:03.725310 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:09:03.725841 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:03.725440 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2jfb" podUID="4faba139-910e-4c25-83b8-41797f237bf8" Sep 15 12:09:04.699538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:04.699509 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:04.724459 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:04.724437 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:09:04.724459 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:04.724455 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:09:04.724625 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:04.724531 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqj7b" podUID="b7b35aca-f916-427c-a664-c01548bdef0f" Sep 15 12:09:04.724625 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:04.724585 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqtr5" podUID="c5224c06-9441-4fa1-9e01-bdcad9e209ca" Sep 15 12:09:04.752477 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:04.752449 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:04.904357 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:04.904317 2554 generic.go:356] "Generic (PLEG): container finished" podID="346a39f9-47a5-48bc-84c9-3365140ca411" containerID="83c8f6520952f87271290f47dc41f909997747298ba0227b295795b787ae6e01" exitCode=0 Sep 15 12:09:04.904501 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:04.904378 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s57mq" event={"ID":"346a39f9-47a5-48bc-84c9-3365140ca411","Type":"ContainerDied","Data":"83c8f6520952f87271290f47dc41f909997747298ba0227b295795b787ae6e01"} Sep 15 12:09:05.423606 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.423437 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeReady" Sep 15 12:09:05.423777 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.423708 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 15 12:09:05.477616 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.477586 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pbjdd"] Sep 15 12:09:05.495396 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.495322 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ks7zh"] Sep 15 12:09:05.495536 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.495516 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.498507 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.498480 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 15 12:09:05.498662 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.498563 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6wlkv\"" Sep 15 12:09:05.499543 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.498977 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 15 12:09:05.511422 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.511400 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pbjdd"] Sep 15 12:09:05.511422 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.511415 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ks7zh" Sep 15 12:09:05.511563 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.511451 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ks7zh"] Sep 15 12:09:05.511563 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.511468 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8pnz4"] Sep 15 12:09:05.513741 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.513726 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-r6gtc\"" Sep 15 12:09:05.514087 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.514045 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 15 12:09:05.514161 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.514088 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 15 12:09:05.514262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.514247 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 15 12:09:05.522040 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.522021 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8pnz4"] Sep 15 12:09:05.522168 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.522154 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.526589 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.526568 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 15 12:09:05.526770 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.526665 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 15 12:09:05.526770 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.526679 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6dnjc\"" Sep 15 12:09:05.526770 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.526580 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 15 12:09:05.526949 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.526874 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 15 12:09:05.582500 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.582478 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3aeddc0-d979-438c-8774-09a0c5a43dbe-config-volume\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.582500 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.582503 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179-cert\") pod \"ingress-canary-ks7zh\" (UID: \"04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179\") " pod="openshift-ingress-canary/ingress-canary-ks7zh" Sep 15 12:09:05.582671 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.582523 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szwqs\" (UniqueName: \"kubernetes.io/projected/f3aeddc0-d979-438c-8774-09a0c5a43dbe-kube-api-access-szwqs\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.583055 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.582977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6kzr\" (UniqueName: \"kubernetes.io/projected/04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179-kube-api-access-c6kzr\") pod \"ingress-canary-ks7zh\" (UID: \"04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179\") " pod="openshift-ingress-canary/ingress-canary-ks7zh" Sep 15 12:09:05.583055 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.583041 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3aeddc0-d979-438c-8774-09a0c5a43dbe-metrics-tls\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.583220 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.583102 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3aeddc0-d979-438c-8774-09a0c5a43dbe-tmp-dir\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.602900 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.602871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:05.684108 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684078 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6kzr\" (UniqueName: \"kubernetes.io/projected/04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179-kube-api-access-c6kzr\") pod \"ingress-canary-ks7zh\" (UID: \"04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179\") " pod="openshift-ingress-canary/ingress-canary-ks7zh" Sep 15 12:09:05.684232 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684119 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d20c77d-ef6d-41a8-8dee-f353401bdb55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.684232 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684150 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3aeddc0-d979-438c-8774-09a0c5a43dbe-metrics-tls\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.684232 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684212 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3aeddc0-d979-438c-8774-09a0c5a43dbe-tmp-dir\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.684369 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d20c77d-ef6d-41a8-8dee-f353401bdb55-crio-socket\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.684369 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684279 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d20c77d-ef6d-41a8-8dee-f353401bdb55-data-volume\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.684369 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684294 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d20c77d-ef6d-41a8-8dee-f353401bdb55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.684533 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684387 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scx9m\" (UniqueName: \"kubernetes.io/projected/6d20c77d-ef6d-41a8-8dee-f353401bdb55-kube-api-access-scx9m\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.684533 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684430 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3aeddc0-d979-438c-8774-09a0c5a43dbe-config-volume\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.684533 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684460 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179-cert\") pod \"ingress-canary-ks7zh\" (UID: \"04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179\") " pod="openshift-ingress-canary/ingress-canary-ks7zh" Sep 15 12:09:05.684533 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szwqs\" (UniqueName: \"kubernetes.io/projected/f3aeddc0-d979-438c-8774-09a0c5a43dbe-kube-api-access-szwqs\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.684714 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684567 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3aeddc0-d979-438c-8774-09a0c5a43dbe-tmp-dir\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.684874 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.684857 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3aeddc0-d979-438c-8774-09a0c5a43dbe-config-volume\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.688067 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.688037 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3aeddc0-d979-438c-8774-09a0c5a43dbe-metrics-tls\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.688164 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.688084 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179-cert\") pod \"ingress-canary-ks7zh\" (UID: \"04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179\") " pod="openshift-ingress-canary/ingress-canary-ks7zh" Sep 15 12:09:05.692348 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.692317 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6kzr\" (UniqueName: \"kubernetes.io/projected/04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179-kube-api-access-c6kzr\") pod \"ingress-canary-ks7zh\" (UID: \"04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179\") " pod="openshift-ingress-canary/ingress-canary-ks7zh" Sep 15 12:09:05.692435 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.692316 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szwqs\" (UniqueName: \"kubernetes.io/projected/f3aeddc0-d979-438c-8774-09a0c5a43dbe-kube-api-access-szwqs\") pod \"dns-default-pbjdd\" (UID: \"f3aeddc0-d979-438c-8774-09a0c5a43dbe\") " pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.702966 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.702941 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:05.725948 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.725923 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:09:05.728954 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.728933 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxzl4\"" Sep 15 12:09:05.729050 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.728941 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 12:09:05.729050 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.728981 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 12:09:05.785045 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.784990 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d20c77d-ef6d-41a8-8dee-f353401bdb55-crio-socket\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.785045 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.785015 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d20c77d-ef6d-41a8-8dee-f353401bdb55-data-volume\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.785045 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.785031 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d20c77d-ef6d-41a8-8dee-f353401bdb55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.785523 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.785059 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scx9m\" (UniqueName: \"kubernetes.io/projected/6d20c77d-ef6d-41a8-8dee-f353401bdb55-kube-api-access-scx9m\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.785523 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.785086 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d20c77d-ef6d-41a8-8dee-f353401bdb55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.785523 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.785201 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d20c77d-ef6d-41a8-8dee-f353401bdb55-crio-socket\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.785523 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.785319 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d20c77d-ef6d-41a8-8dee-f353401bdb55-data-volume\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.785646 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.785606 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d20c77d-ef6d-41a8-8dee-f353401bdb55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.787251 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.787230 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d20c77d-ef6d-41a8-8dee-f353401bdb55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.793795 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.793773 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scx9m\" (UniqueName: \"kubernetes.io/projected/6d20c77d-ef6d-41a8-8dee-f353401bdb55-kube-api-access-scx9m\") pod \"insights-runtime-extractor-8pnz4\" (UID: \"6d20c77d-ef6d-41a8-8dee-f353401bdb55\") " pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.805768 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.805736 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:05.819830 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.819812 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ks7zh" Sep 15 12:09:05.842630 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.842614 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8pnz4" Sep 15 12:09:05.915158 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.915130 2554 generic.go:356] "Generic (PLEG): container finished" podID="346a39f9-47a5-48bc-84c9-3365140ca411" containerID="ef24d0b6f8e62e0e4f689eb2f25a2ad6414abad19745e9c2408e05743a0053cc" exitCode=0 Sep 15 12:09:05.915245 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:05.915174 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s57mq" event={"ID":"346a39f9-47a5-48bc-84c9-3365140ca411","Type":"ContainerDied","Data":"ef24d0b6f8e62e0e4f689eb2f25a2ad6414abad19745e9c2408e05743a0053cc"} Sep 15 12:09:06.136183 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.136025 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ks7zh"] Sep 15 12:09:06.137799 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.137779 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pbjdd"] Sep 15 12:09:06.139654 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:06.139634 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ec1fbd_a1a1_40fb_a1fe_db24fb2d4179.slice/crio-25cc819fddfca74f46d6fe9eb6b34ab7d5ac987b4639c79e4298bb1373ca16dc WatchSource:0}: Error finding container 25cc819fddfca74f46d6fe9eb6b34ab7d5ac987b4639c79e4298bb1373ca16dc: Status 404 returned error can't find the container with id 25cc819fddfca74f46d6fe9eb6b34ab7d5ac987b4639c79e4298bb1373ca16dc Sep 15 12:09:06.141028 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:06.141008 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3aeddc0_d979_438c_8774_09a0c5a43dbe.slice/crio-d37406ade7339cf43fbd39a6d1bc9c14568f80c2cc7e3ba17a4d13455b4fd338 WatchSource:0}: Error finding container d37406ade7339cf43fbd39a6d1bc9c14568f80c2cc7e3ba17a4d13455b4fd338: Status 404 returned error can't find the container with id d37406ade7339cf43fbd39a6d1bc9c14568f80c2cc7e3ba17a4d13455b4fd338 Sep 15 12:09:06.176515 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.176490 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8pnz4"] Sep 15 12:09:06.179206 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:06.179178 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d20c77d_ef6d_41a8_8dee_f353401bdb55.slice/crio-79ac813bda95d40d263ca1c3aa5db25c935397c71094b2e27288b8c2f98f411e WatchSource:0}: Error finding container 79ac813bda95d40d263ca1c3aa5db25c935397c71094b2e27288b8c2f98f411e: Status 404 returned error can't find the container with id 79ac813bda95d40d263ca1c3aa5db25c935397c71094b2e27288b8c2f98f411e Sep 15 12:09:06.712845 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.712816 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54d47c8b87-mlv4p"] Sep 15 12:09:06.729656 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.729629 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:09:06.729656 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.729644 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.729892 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.729742 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:09:06.733013 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.732988 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54d47c8b87-mlv4p"] Sep 15 12:09:06.735457 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.735431 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 15 12:09:06.735773 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.735734 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 12:09:06.735858 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.735816 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 15 12:09:06.736384 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.736363 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 15 12:09:06.736486 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.736422 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lvgsg\"" Sep 15 12:09:06.736486 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.736428 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 15 12:09:06.736607 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.736513 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 15 12:09:06.736607 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.736578 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 12:09:06.736718 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.736677 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 15 12:09:06.736797 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.736776 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 15 12:09:06.737009 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.736973 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qplds\"" Sep 15 12:09:06.893910 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.893862 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-oauth-serving-cert\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.894638 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.893924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-config\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.894638 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.893966 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-oauth-config\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.894638 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.894005 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-service-ca\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.894638 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.894043 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77qns\" (UniqueName: \"kubernetes.io/projected/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-kube-api-access-77qns\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.894638 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.894080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-serving-cert\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.920274 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.920223 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pbjdd" event={"ID":"f3aeddc0-d979-438c-8774-09a0c5a43dbe","Type":"ContainerStarted","Data":"d37406ade7339cf43fbd39a6d1bc9c14568f80c2cc7e3ba17a4d13455b4fd338"} Sep 15 12:09:06.925455 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.925134 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s57mq" event={"ID":"346a39f9-47a5-48bc-84c9-3365140ca411","Type":"ContainerStarted","Data":"61189fc34dc40ff0cbfda7eaf187c875dc9e1f995478ebedf32a0a017c54f390"} Sep 15 12:09:06.927716 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.927686 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8pnz4" event={"ID":"6d20c77d-ef6d-41a8-8dee-f353401bdb55","Type":"ContainerStarted","Data":"56ffb0647e9b7d125a84b0972fa8035926139423f4288a254274aec424bb2a37"} Sep 15 12:09:06.927849 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.927766 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8pnz4" event={"ID":"6d20c77d-ef6d-41a8-8dee-f353401bdb55","Type":"ContainerStarted","Data":"79ac813bda95d40d263ca1c3aa5db25c935397c71094b2e27288b8c2f98f411e"} Sep 15 12:09:06.930290 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.930259 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ks7zh" event={"ID":"04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179","Type":"ContainerStarted","Data":"25cc819fddfca74f46d6fe9eb6b34ab7d5ac987b4639c79e4298bb1373ca16dc"} Sep 15 12:09:06.948518 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.948176 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s57mq" podStartSLOduration=8.746095031 podStartE2EDuration="40.948156963s" totalImagesPullingTime="32.202061932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:06.946526255 +0000 UTC m=+41.830720965" watchObservedRunningTime="2026-09-15 12:09:06.948156963 +0000 UTC m=+41.832351673" Sep 15 12:09:06.995416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.995349 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-oauth-config\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.995416 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.995396 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-service-ca\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.995592 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.995442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77qns\" (UniqueName: \"kubernetes.io/projected/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-kube-api-access-77qns\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.995592 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.995480 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-serving-cert\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.995592 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.995537 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-oauth-serving-cert\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.995712 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.995595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-config\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.996593 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.996572 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-config\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.996593 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.996584 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-oauth-serving-cert\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:06.997049 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:06.997020 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-service-ca\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:07.000192 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:07.000170 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-oauth-config\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:07.000267 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:07.000243 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-serving-cert\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:07.016970 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:07.016944 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77qns\" (UniqueName: \"kubernetes.io/projected/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-kube-api-access-77qns\") pod \"console-54d47c8b87-mlv4p\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:07.051065 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:07.050876 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:07.092364 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:07.092332 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:07.191385 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:07.191347 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:07.510829 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:07.510797 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54d47c8b87-mlv4p"] Sep 15 12:09:08.128452 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:08.128418 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd5d5b3_fa43_40e0_9264_e4e065a7fb48.slice/crio-b013f02193614a0b6ffea11abb05e2a8c8faeaf70d1116f52efae0e1a6b3acbc WatchSource:0}: Error finding container b013f02193614a0b6ffea11abb05e2a8c8faeaf70d1116f52efae0e1a6b3acbc: Status 404 returned error can't find the container with id b013f02193614a0b6ffea11abb05e2a8c8faeaf70d1116f52efae0e1a6b3acbc Sep 15 12:09:08.852106 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:08.851913 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:08.908036 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:08.908003 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:08.937818 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:08.937765 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8pnz4" event={"ID":"6d20c77d-ef6d-41a8-8dee-f353401bdb55","Type":"ContainerStarted","Data":"b59337fdca2c34d3d52077f4df6a92be855fde5f78332c3a66cc0ffeb8a854b2"} Sep 15 12:09:08.939119 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:08.939088 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d47c8b87-mlv4p" event={"ID":"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48","Type":"ContainerStarted","Data":"b013f02193614a0b6ffea11abb05e2a8c8faeaf70d1116f52efae0e1a6b3acbc"} Sep 15 12:09:09.366495 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:09.366471 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:09.466498 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:09.466478 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:09.567835 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:09.567809 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:09.944697 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:09.944417 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ks7zh" event={"ID":"04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179","Type":"ContainerStarted","Data":"a184a7cb4cbb3994c537ab984dd6e49a3aa92b0601e6a1b56252d53dfdeb38e7"} Sep 15 12:09:09.946885 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:09.946853 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pbjdd" event={"ID":"f3aeddc0-d979-438c-8774-09a0c5a43dbe","Type":"ContainerStarted","Data":"595ab0b7670daa7bd6b3b6cdfbac410040b32b83c3f23b6c001f4cb716fd1754"} Sep 15 12:09:09.947018 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:09.946918 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pbjdd" event={"ID":"f3aeddc0-d979-438c-8774-09a0c5a43dbe","Type":"ContainerStarted","Data":"803a4661796142d77841e837e65bc07fd15196cfcfe6707e9e6ca3b26e13811f"} Sep 15 12:09:09.947123 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:09.947094 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:09.979074 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:09.978934 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pbjdd" podStartSLOduration=1.777363642 podStartE2EDuration="4.978912808s" totalImagesPullingTime="3.201549166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:09.978762423 +0000 UTC m=+44.862957128" watchObservedRunningTime="2026-09-15 12:09:09.978912808 +0000 UTC m=+44.863107513" Sep 15 12:09:09.979559 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:09.979509 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ks7zh" podStartSLOduration=1.4598434980000001 podStartE2EDuration="4.979494034s" totalImagesPullingTime="3.519650536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:09.960203392 +0000 UTC m=+44.844398101" watchObservedRunningTime="2026-09-15 12:09:09.979494034 +0000 UTC m=+44.863688744" Sep 15 12:09:10.854876 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:10.854839 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:10.916126 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:10.916088 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:12.888285 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:12.888138 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:12.946870 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:12.946845 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:12.957861 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:12.957833 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8pnz4" event={"ID":"6d20c77d-ef6d-41a8-8dee-f353401bdb55","Type":"ContainerStarted","Data":"89e65b1a4bc236150cfa74eedcfd67ffe98fd338603b136296926458d5239591"} Sep 15 12:09:12.959346 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:12.959324 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d47c8b87-mlv4p" event={"ID":"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48","Type":"ContainerStarted","Data":"7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41"} Sep 15 12:09:12.976999 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:12.976950 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8pnz4" podStartSLOduration=2.26275108 podStartE2EDuration="7.976931609s" totalImagesPullingTime="5.714180529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:09:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:12.976613577 +0000 UTC m=+47.860808287" watchObservedRunningTime="2026-09-15 12:09:12.976931609 +0000 UTC m=+47.861126321" Sep 15 12:09:12.999512 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:12.999472 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54d47c8b87-mlv4p" podStartSLOduration=2.757840994 podStartE2EDuration="6.999458619s" totalImagesPullingTime="4.241617625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:12.998821769 +0000 UTC m=+47.883016477" watchObservedRunningTime="2026-09-15 12:09:12.999458619 +0000 UTC m=+47.883653327" Sep 15 12:09:13.293577 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.293529 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:13.338849 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.338817 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x"] Sep 15 12:09:13.362722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.362688 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x"] Sep 15 12:09:13.362871 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.362817 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.365471 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.365447 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 15 12:09:13.365471 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.365445 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 15 12:09:13.366272 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.366250 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 15 12:09:13.366382 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.366276 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jgdnx\"" Sep 15 12:09:13.366382 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.366305 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 15 12:09:13.366382 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.366254 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 15 12:09:13.382424 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.382396 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:13.448960 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.448930 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.449100 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.448985 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jc97\" (UniqueName: \"kubernetes.io/projected/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-kube-api-access-6jc97\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.449100 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.449016 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.449100 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.449037 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.468714 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.468690 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:13.549978 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.549904 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.549978 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.549957 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jc97\" (UniqueName: \"kubernetes.io/projected/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-kube-api-access-6jc97\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.550172 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.549990 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.550172 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.550009 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.550623 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.550599 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.553718 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.553697 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.553807 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.553701 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.558159 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.558139 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jc97\" (UniqueName: \"kubernetes.io/projected/ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2-kube-api-access-6jc97\") pod \"prometheus-operator-68bcd7f987-vjk7x\" (UID: \"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.671676 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.671641 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" Sep 15 12:09:13.847055 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.846983 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-868c5566fd-4ms6p"] Sep 15 12:09:13.877401 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.877374 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868c5566fd-4ms6p"] Sep 15 12:09:13.877540 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.877462 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:13.886735 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.886715 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 15 12:09:13.960878 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:13.960818 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x"] Sep 15 12:09:13.965436 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:13.965413 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea7d3f6a_4084_4c40_8e8b_3a1eb38726c2.slice/crio-cd398c762014060befb805b50b8d6321a4b4012bd7f5650dd28870e6fb44faca WatchSource:0}: Error finding container cd398c762014060befb805b50b8d6321a4b4012bd7f5650dd28870e6fb44faca: Status 404 returned error can't find the container with id cd398c762014060befb805b50b8d6321a4b4012bd7f5650dd28870e6fb44faca Sep 15 12:09:14.053329 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.053295 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t9tr\" (UniqueName: \"kubernetes.io/projected/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-kube-api-access-9t9tr\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.053329 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.053333 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-oauth-config\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.053535 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.053367 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-service-ca\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.053535 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.053392 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-oauth-serving-cert\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.053535 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.053504 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-config\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.053671 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.053577 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-serving-cert\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.053671 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.053603 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-trusted-ca-bundle\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.154131 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.154029 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-trusted-ca-bundle\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.154281 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.154141 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t9tr\" (UniqueName: \"kubernetes.io/projected/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-kube-api-access-9t9tr\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.154281 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.154179 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-oauth-config\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.154281 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.154203 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-service-ca\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.154281 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.154224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-oauth-serving-cert\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.154281 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.154271 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-config\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.154531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.154300 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-serving-cert\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.154918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.154885 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-service-ca\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.155038 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.154925 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-trusted-ca-bundle\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.155038 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.154933 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-oauth-serving-cert\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.155038 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.155025 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-config\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.156892 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.156872 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-oauth-config\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.156992 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.156948 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-serving-cert\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.162375 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.162352 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t9tr\" (UniqueName: \"kubernetes.io/projected/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-kube-api-access-9t9tr\") pod \"console-868c5566fd-4ms6p\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.186372 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.186348 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:14.490132 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.490104 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868c5566fd-4ms6p"] Sep 15 12:09:14.493504 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:14.493480 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b46e68e_a11d_44f9_b06e_b3a6edf0013a.slice/crio-2a8414cc5f589e195b7f44a746f9cfc0c9730430ac151b4e18319b3882b513b9 WatchSource:0}: Error finding container 2a8414cc5f589e195b7f44a746f9cfc0c9730430ac151b4e18319b3882b513b9: Status 404 returned error can't find the container with id 2a8414cc5f589e195b7f44a746f9cfc0c9730430ac151b4e18319b3882b513b9 Sep 15 12:09:14.967891 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.967627 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868c5566fd-4ms6p" event={"ID":"9b46e68e-a11d-44f9-b06e-b3a6edf0013a","Type":"ContainerStarted","Data":"e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb"} Sep 15 12:09:14.968322 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.967911 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868c5566fd-4ms6p" event={"ID":"9b46e68e-a11d-44f9-b06e-b3a6edf0013a","Type":"ContainerStarted","Data":"2a8414cc5f589e195b7f44a746f9cfc0c9730430ac151b4e18319b3882b513b9"} Sep 15 12:09:14.968772 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.968737 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" event={"ID":"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2","Type":"ContainerStarted","Data":"cd398c762014060befb805b50b8d6321a4b4012bd7f5650dd28870e6fb44faca"} Sep 15 12:09:14.986378 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:14.986334 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-868c5566fd-4ms6p" podStartSLOduration=1.9863210100000002 podStartE2EDuration="1.98632101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:09:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:14.98503747 +0000 UTC m=+49.869232179" watchObservedRunningTime="2026-09-15 12:09:14.98632101 +0000 UTC m=+49.870515718" Sep 15 12:09:15.639441 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:15.639410 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:15.974087 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:15.974049 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" event={"ID":"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2","Type":"ContainerStarted","Data":"2100cecf3394fa96c3e21360625800a0a3fdeda8e6efdfc3dcfbcd8e2438e4f0"} Sep 15 12:09:15.974807 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:15.974099 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" event={"ID":"ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2","Type":"ContainerStarted","Data":"3547bb6a5b993af1a0e0f14708df5f233e8c0f2ccb68562e79fce8835b2f66e5"} Sep 15 12:09:15.989949 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:15.989907 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vjk7x" podStartSLOduration=1.559394884 podStartE2EDuration="2.989891813s" totalImagesPullingTime="1.430496929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:15.988885075 +0000 UTC m=+50.873079784" watchObservedRunningTime="2026-09-15 12:09:15.989891813 +0000 UTC m=+50.874086522" Sep 15 12:09:17.051478 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.051440 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:17.051968 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.051503 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:17.056500 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.056477 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:17.464439 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.464409 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:17.680573 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.680545 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:17.701317 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.701293 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl"] Sep 15 12:09:17.703386 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.703372 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:17.705814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.705795 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pffbg\"" Sep 15 12:09:17.706043 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.706031 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 15 12:09:17.706126 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.706036 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 15 12:09:17.718464 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.718413 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl"] Sep 15 12:09:17.746465 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.746441 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k9sq2"] Sep 15 12:09:17.748515 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.748498 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.751046 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.751029 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 15 12:09:17.751201 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.751186 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 15 12:09:17.753646 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.753632 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 15 12:09:17.762873 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.762855 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hgxc9\"" Sep 15 12:09:17.823585 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.823560 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:17.881999 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.881967 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-wtmp\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.882129 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882001 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.882129 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882095 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:17.882222 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882126 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:17.882222 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882152 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdgwd\" (UniqueName: \"kubernetes.io/projected/6ac69496-d958-486c-8f81-9a6235b994ce-kube-api-access-sdgwd\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.882222 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882173 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ac69496-d958-486c-8f81-9a6235b994ce-metrics-client-ca\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.882222 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882187 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-494jc\" (UniqueName: \"kubernetes.io/projected/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-kube-api-access-494jc\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:17.882422 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882227 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ac69496-d958-486c-8f81-9a6235b994ce-root\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.882422 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882256 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.882422 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882339 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:17.882422 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ac69496-d958-486c-8f81-9a6235b994ce-sys\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.882422 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882400 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-textfile\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.882594 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.882424 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-tls\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.983999 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.983903 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:17.984130 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:17.984069 2554 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 15 12:09:17.984407 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984390 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ac69496-d958-486c-8f81-9a6235b994ce-sys\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.984469 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984397 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ac69496-d958-486c-8f81-9a6235b994ce-sys\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.984469 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984455 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-textfile\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.984553 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:17.984474 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-openshift-state-metrics-tls podName:b5ac26a6-517d-4cfc-bc0d-c98849214cdf nodeName:}" failed. No retries permitted until 2026-09-15 12:09:18.484448406 +0000 UTC m=+53.368643113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-zjbxl" (UID: "b5ac26a6-517d-4cfc-bc0d-c98849214cdf") : secret "openshift-state-metrics-tls" not found Sep 15 12:09:17.984553 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-tls\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.984650 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984554 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-wtmp\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.984650 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984582 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.984650 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:17.984832 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:17.984655 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 15 12:09:17.984832 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984662 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:17.984832 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984688 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdgwd\" (UniqueName: \"kubernetes.io/projected/6ac69496-d958-486c-8f81-9a6235b994ce-kube-api-access-sdgwd\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.984832 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:17.984707 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-tls podName:6ac69496-d958-486c-8f81-9a6235b994ce nodeName:}" failed. No retries permitted until 2026-09-15 12:09:18.484690119 +0000 UTC m=+53.368884807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-tls") pod "node-exporter-k9sq2" (UID: "6ac69496-d958-486c-8f81-9a6235b994ce") : secret "node-exporter-tls" not found Sep 15 12:09:17.984832 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984732 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-wtmp\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.984832 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984771 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ac69496-d958-486c-8f81-9a6235b994ce-metrics-client-ca\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.984832 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984779 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-textfile\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.984832 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984801 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-494jc\" (UniqueName: \"kubernetes.io/projected/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-kube-api-access-494jc\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:17.985243 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.984999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ac69496-d958-486c-8f81-9a6235b994ce-root\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.985243 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.985024 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.985243 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.985098 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ac69496-d958-486c-8f81-9a6235b994ce-root\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.985415 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.985378 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.985726 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.985707 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ac69496-d958-486c-8f81-9a6235b994ce-metrics-client-ca\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.985845 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.985788 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:17.987358 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.987338 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:17.988083 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.988063 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.988149 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.988134 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:17.994937 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.994918 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdgwd\" (UniqueName: \"kubernetes.io/projected/6ac69496-d958-486c-8f81-9a6235b994ce-kube-api-access-sdgwd\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:17.995727 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:17.995709 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-494jc\" (UniqueName: \"kubernetes.io/projected/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-kube-api-access-494jc\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:18.105280 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.105253 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:18.206030 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.206006 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:18.306730 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.306659 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:18.406681 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.406654 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:18.488417 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.488378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:18.488571 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.488426 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-tls\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:18.490706 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.490676 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ac69496-d958-486c-8f81-9a6235b994ce-node-exporter-tls\") pod \"node-exporter-k9sq2\" (UID: \"6ac69496-d958-486c-8f81-9a6235b994ce\") " pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:18.490866 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.490737 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5ac26a6-517d-4cfc-bc0d-c98849214cdf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-zjbxl\" (UID: \"b5ac26a6-517d-4cfc-bc0d-c98849214cdf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:18.509709 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.509686 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:18.612524 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.612450 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" Sep 15 12:09:18.657118 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.657090 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9sq2" Sep 15 12:09:18.668320 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:18.668285 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac69496_d958_486c_8f81_9a6235b994ce.slice/crio-00f3946b5281af19ada479a27c1cf4561fd8c2a9e8d1eb9fd6d08298f530e1a5 WatchSource:0}: Error finding container 00f3946b5281af19ada479a27c1cf4561fd8c2a9e8d1eb9fd6d08298f530e1a5: Status 404 returned error can't find the container with id 00f3946b5281af19ada479a27c1cf4561fd8c2a9e8d1eb9fd6d08298f530e1a5 Sep 15 12:09:18.718671 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.718607 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:18.793380 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.793348 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:18.798734 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.798701 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:09:18.801562 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.801544 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.804894 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.804678 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 15 12:09:18.804894 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.804704 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 15 12:09:18.804894 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.804678 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 15 12:09:18.804894 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.804780 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 15 12:09:18.805190 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.804931 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 15 12:09:18.805190 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.805029 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-54wbn\"" Sep 15 12:09:18.805375 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.805311 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 15 12:09:18.805375 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.805328 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 15 12:09:18.805375 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.805351 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 15 12:09:18.805691 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.805357 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 15 12:09:18.824085 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.824061 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:09:18.885126 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.885022 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl"] Sep 15 12:09:18.889612 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:18.889593 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ac26a6_517d_4cfc_bc0d_c98849214cdf.slice/crio-7160c5a5893862684f0da1824e2b8b96aefc8039cb4f7d1acacd279496397882 WatchSource:0}: Error finding container 7160c5a5893862684f0da1824e2b8b96aefc8039cb4f7d1acacd279496397882: Status 404 returned error can't find the container with id 7160c5a5893862684f0da1824e2b8b96aefc8039cb4f7d1acacd279496397882 Sep 15 12:09:18.892306 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892283 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892396 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892315 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-config-out\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892396 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892349 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892510 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892444 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892559 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892525 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892615 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jwd\" (UniqueName: \"kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-kube-api-access-76jwd\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892615 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892586 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-web-config\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892716 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892619 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892716 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892648 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892716 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892675 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-config-volume\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892716 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892704 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892910 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892730 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.892910 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.892773 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.941684 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.941653 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:18.987484 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.987454 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9sq2" event={"ID":"6ac69496-d958-486c-8f81-9a6235b994ce","Type":"ContainerStarted","Data":"00f3946b5281af19ada479a27c1cf4561fd8c2a9e8d1eb9fd6d08298f530e1a5"} Sep 15 12:09:18.988917 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.988894 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" event={"ID":"b5ac26a6-517d-4cfc-bc0d-c98849214cdf","Type":"ContainerStarted","Data":"eaad83922eb74e6688ba4b1d974f66e3d85033b280345abf3b79404f0b4883a5"} Sep 15 12:09:18.989014 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.988938 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" event={"ID":"b5ac26a6-517d-4cfc-bc0d-c98849214cdf","Type":"ContainerStarted","Data":"7160c5a5893862684f0da1824e2b8b96aefc8039cb4f7d1acacd279496397882"} Sep 15 12:09:18.994144 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994118 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994252 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994156 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-config-out\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994252 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994177 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994362 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:18.994272 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-trusted-ca-bundle podName:07e936bd-8b4f-44ab-a264-0a29c6669def nodeName:}" failed. No retries permitted until 2026-09-15 12:09:19.494251075 +0000 UTC m=+54.378445762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def") : configmap references non-existent config key: ca-bundle.crt Sep 15 12:09:18.994362 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994294 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994482 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994365 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994482 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994424 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76jwd\" (UniqueName: \"kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-kube-api-access-76jwd\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994482 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-web-config\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994628 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994480 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994628 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994509 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994628 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994537 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-config-volume\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994628 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994563 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994628 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994628 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994624 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994928 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994840 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.994996 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.994943 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.998398 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.998372 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-config-out\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.998575 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.998549 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.998683 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.998549 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-config-volume\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.999066 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.998997 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.999285 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.999264 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.999361 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.999268 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:18.999361 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:18.999335 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:19.000204 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.000187 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:19.000409 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.000396 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-web-config\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:19.006146 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.006128 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jwd\" (UniqueName: \"kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-kube-api-access-76jwd\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:19.030675 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.030652 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:19.345939 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.345884 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:19.413981 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.413929 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:19.500344 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.500310 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:19.501124 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.501100 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:19.711807 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.711642 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:09:19.717264 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.717240 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:19.786522 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.786469 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:19.886612 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.886581 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:19.951924 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.951848 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pbjdd" Sep 15 12:09:19.978711 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.978665 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:19.994871 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.994820 2554 generic.go:356] "Generic (PLEG): container finished" podID="6ac69496-d958-486c-8f81-9a6235b994ce" containerID="af0fe9d630d6d8ec23e470b6f843e6e6cc4d2e6b7206be0b145b79c3a7a80cbc" exitCode=0 Sep 15 12:09:19.995053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.994940 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9sq2" event={"ID":"6ac69496-d958-486c-8f81-9a6235b994ce","Type":"ContainerDied","Data":"af0fe9d630d6d8ec23e470b6f843e6e6cc4d2e6b7206be0b145b79c3a7a80cbc"} Sep 15 12:09:19.997992 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:19.997959 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" event={"ID":"b5ac26a6-517d-4cfc-bc0d-c98849214cdf","Type":"ContainerStarted","Data":"e60efe2ca2e02ea1a1ad9fd2dca00c073f539543c8c213e7196d3718dee2a308"} Sep 15 12:09:20.001647 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:20.001619 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:09:20.009090 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:20.009068 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e936bd_8b4f_44ab_a264_0a29c6669def.slice/crio-9d5e72e54cc83a32455cf77001a0c5bec7a425af45b341d18190e126ba988500 WatchSource:0}: Error finding container 9d5e72e54cc83a32455cf77001a0c5bec7a425af45b341d18190e126ba988500: Status 404 returned error can't find the container with id 9d5e72e54cc83a32455cf77001a0c5bec7a425af45b341d18190e126ba988500 Sep 15 12:09:20.628161 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:20.628085 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:20.694630 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:20.694596 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:20.794097 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:20.794062 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:20.894472 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:20.894394 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:21.007009 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:21.006974 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" event={"ID":"b5ac26a6-517d-4cfc-bc0d-c98849214cdf","Type":"ContainerStarted","Data":"b7dd255af764499a62eba23c6d3743ab9c86757b8e70ba5f432177b4a178b073"} Sep 15 12:09:21.008503 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:21.008476 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerStarted","Data":"9d5e72e54cc83a32455cf77001a0c5bec7a425af45b341d18190e126ba988500"} Sep 15 12:09:21.010803 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:21.010776 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9sq2" event={"ID":"6ac69496-d958-486c-8f81-9a6235b994ce","Type":"ContainerStarted","Data":"2eb366249c1160d36f45dce64eb6d5eb8e3c75924a06729a121c87effef74dd0"} Sep 15 12:09:21.010909 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:21.010817 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9sq2" event={"ID":"6ac69496-d958-486c-8f81-9a6235b994ce","Type":"ContainerStarted","Data":"999a7c6475762f845c95355b0b1c29d87801e7958cdaa2ab7a919cbfa5ed9bc6"} Sep 15 12:09:21.020231 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:21.020190 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:21.034484 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:21.034435 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-zjbxl" podStartSLOduration=2.6987801019999997 podStartE2EDuration="4.034419443s" totalImagesPullingTime="1.335639341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:21.033097804 +0000 UTC m=+55.917292513" watchObservedRunningTime="2026-09-15 12:09:21.034419443 +0000 UTC m=+55.918614152" Sep 15 12:09:21.055018 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:21.054963 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k9sq2" podStartSLOduration=2.958440564 podStartE2EDuration="4.054944674s" totalImagesPullingTime="1.022176485s" totalInitContainerRuntime="74.327625ms" isStatefulPod=true podCreationTimestamp="2026-09-15 12:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:21.054053682 +0000 UTC m=+55.938248391" watchObservedRunningTime="2026-09-15 12:09:21.054944674 +0000 UTC m=+55.939139393" Sep 15 12:09:22.015491 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.015460 2554 generic.go:356] "Generic (PLEG): container finished" podID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerID="077b0875c42b6d53493a94b7e49cf424745e6b04b37d2722af565ba7ac0c6d8b" exitCode=0 Sep 15 12:09:22.015900 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.015546 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerDied","Data":"077b0875c42b6d53493a94b7e49cf424745e6b04b37d2722af565ba7ac0c6d8b"} Sep 15 12:09:22.514473 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.514438 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:22.527075 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.527043 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868c5566fd-4ms6p"] Sep 15 12:09:22.577988 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.577958 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77d7c7789b-f78nx"] Sep 15 12:09:22.581824 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.581809 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.596700 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.596676 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d7c7789b-f78nx"] Sep 15 12:09:22.617473 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.617303 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:22.729574 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.729546 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-config\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.729717 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.729578 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-oauth-config\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.729717 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.729614 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-oauth-serving-cert\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.729717 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.729702 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-trusted-ca-bundle\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.729858 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.729740 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-service-ca\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.729858 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.729813 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-serving-cert\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.729858 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.729829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtjwl\" (UniqueName: \"kubernetes.io/projected/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-kube-api-access-xtjwl\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.830388 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.830318 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtjwl\" (UniqueName: \"kubernetes.io/projected/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-kube-api-access-xtjwl\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.830388 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.830367 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-config\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.830538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.830391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-oauth-config\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.830538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.830438 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-oauth-serving-cert\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.830538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.830478 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-trusted-ca-bundle\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.830538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.830508 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-service-ca\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.830742 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.830565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-serving-cert\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.831162 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.831136 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-config\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.831242 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.831179 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-oauth-serving-cert\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.831288 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.831265 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-service-ca\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.831425 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.831401 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-trusted-ca-bundle\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.832907 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.832888 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-oauth-config\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.833072 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.833054 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-serving-cert\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.838793 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.838775 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtjwl\" (UniqueName: \"kubernetes.io/projected/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-kube-api-access-xtjwl\") pod \"console-77d7c7789b-f78nx\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:22.890502 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:22.890479 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:23.072523 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:23.072491 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:23.168002 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:23.167978 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d7c7789b-f78nx"] Sep 15 12:09:23.170092 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:23.170061 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1dcc9b_ce2f_4be1_86de_440eb45e682f.slice/crio-55d6fd897d4be19ecb736e9d0348d4d4387a85ff09b02de9f985f9c25a890184 WatchSource:0}: Error finding container 55d6fd897d4be19ecb736e9d0348d4d4387a85ff09b02de9f985f9c25a890184: Status 404 returned error can't find the container with id 55d6fd897d4be19ecb736e9d0348d4d4387a85ff09b02de9f985f9c25a890184 Sep 15 12:09:23.279559 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:23.279522 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:23.376723 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:23.376690 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:24.027414 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.027386 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerStarted","Data":"fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e"} Sep 15 12:09:24.029053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.029025 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d7c7789b-f78nx" event={"ID":"8d1dcc9b-ce2f-4be1-86de-440eb45e682f","Type":"ContainerStarted","Data":"78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041"} Sep 15 12:09:24.029151 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.029074 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d7c7789b-f78nx" event={"ID":"8d1dcc9b-ce2f-4be1-86de-440eb45e682f","Type":"ContainerStarted","Data":"55d6fd897d4be19ecb736e9d0348d4d4387a85ff09b02de9f985f9c25a890184"} Sep 15 12:09:24.061764 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.061694 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77d7c7789b-f78nx" podStartSLOduration=2.0616734389999998 podStartE2EDuration="2.061673439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:24.0611512 +0000 UTC m=+58.945345910" watchObservedRunningTime="2026-09-15 12:09:24.061673439 +0000 UTC m=+58.945868150" Sep 15 12:09:24.081814 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.081766 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:09:24.087072 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.086537 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.089010 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.088996 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 15 12:09:24.089081 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.089048 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 15 12:09:24.089081 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.089059 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8j82k6ba28hue\"" Sep 15 12:09:24.089311 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.089290 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 15 12:09:24.089394 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.089293 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 15 12:09:24.089614 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.089595 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 15 12:09:24.089724 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.089709 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 15 12:09:24.090043 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.090027 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 15 12:09:24.090333 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.090310 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 15 12:09:24.090418 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.090400 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8pgs5\"" Sep 15 12:09:24.090685 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.090667 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 15 12:09:24.090763 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.090712 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 15 12:09:24.090926 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.090718 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 15 12:09:24.091075 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.091053 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 15 12:09:24.091589 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.091575 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 15 12:09:24.102178 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.101907 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 15 12:09:24.104577 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.104259 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 15 12:09:24.112078 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.112054 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:09:24.113390 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.113303 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:24.142838 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.142811 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.142953 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.142871 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.142953 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.142896 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm9jh\" (UniqueName: \"kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-kube-api-access-vm9jh\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.142953 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.142937 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143119 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.142960 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143119 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.142982 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config-out\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143119 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143020 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143119 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143055 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143119 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143086 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143341 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143126 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143341 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143154 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143341 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143179 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143341 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143208 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143341 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143240 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143341 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143265 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143341 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143303 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143341 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143340 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143699 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143367 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143699 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143397 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.143699 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.143419 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-web-config\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.186699 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.186652 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:24.218683 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.218640 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:24.244376 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.244348 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.244538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.244519 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.244647 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.244631 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.244788 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.244775 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.244903 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.244887 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.245001 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.244986 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.245126 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.245111 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.245239 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.245225 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.245338 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.245324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.245443 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.245429 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.245530 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.245518 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-web-config\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.245641 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.245629 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.245717 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.245690 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.245805 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.245258 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.245918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.245899 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.246020 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.246005 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm9jh\" (UniqueName: \"kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-kube-api-access-vm9jh\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.246139 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.246124 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.246234 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.246219 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.246339 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.246321 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config-out\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.246471 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.246447 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.246530 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.246148 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.246530 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.246448 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.246631 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.246528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.246631 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.246567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.248961 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.247825 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.248961 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.248665 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.250068 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.250043 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.250451 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.250401 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.250673 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.250649 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.250885 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.250857 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.251463 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.251362 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.251463 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.251422 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.251964 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.251919 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config-out\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.252248 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.252221 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.252847 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.252793 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.252847 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.252814 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.253401 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.253354 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.253401 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.253375 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.254878 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.254733 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-web-config\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.255422 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.255400 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm9jh\" (UniqueName: \"kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-kube-api-access-vm9jh\") pod \"prometheus-k8s-0\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.399649 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.399618 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:24.678957 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:24.678933 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:09:24.680107 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:24.680082 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf574348a_e5e6_4c03_9d6d_d1494f2f3ed9.slice/crio-f138b9980234e06feb3a1ded955b8dc2d22251b36dab4384c494183633f34b0f WatchSource:0}: Error finding container f138b9980234e06feb3a1ded955b8dc2d22251b36dab4384c494183633f34b0f: Status 404 returned error can't find the container with id f138b9980234e06feb3a1ded955b8dc2d22251b36dab4384c494183633f34b0f Sep 15 12:09:25.036483 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:25.036449 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerStarted","Data":"4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16"} Sep 15 12:09:25.036616 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:25.036531 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerStarted","Data":"3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5"} Sep 15 12:09:25.036616 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:25.036566 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerStarted","Data":"19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090"} Sep 15 12:09:25.036616 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:25.036603 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerStarted","Data":"677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad"} Sep 15 12:09:25.037881 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:25.037857 2554 generic.go:356] "Generic (PLEG): container finished" podID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerID="e5b9224f30ea85f18ff1d8fd768c9d6923f9f5528531133fc7d29f3850009abc" exitCode=0 Sep 15 12:09:25.037940 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:25.037896 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerDied","Data":"e5b9224f30ea85f18ff1d8fd768c9d6923f9f5528531133fc7d29f3850009abc"} Sep 15 12:09:25.037979 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:25.037953 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerStarted","Data":"f138b9980234e06feb3a1ded955b8dc2d22251b36dab4384c494183633f34b0f"} Sep 15 12:09:26.036669 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:26.036636 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d8vz" Sep 15 12:09:26.209737 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:26.209699 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:26.272667 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:26.272640 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:26.519070 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:26.519036 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:26.577037 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:26.577005 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:27.053467 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:27.053390 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerStarted","Data":"cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b"} Sep 15 12:09:27.080312 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:27.080264 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.341849168 podStartE2EDuration="9.080246682s" totalImagesPullingTime="5.719753107s" totalInitContainerRuntime="18.644407ms" isStatefulPod=false podCreationTimestamp="2026-09-15 12:09:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:27.078362489 +0000 UTC m=+61.962557199" watchObservedRunningTime="2026-09-15 12:09:27.080246682 +0000 UTC m=+61.964441392" Sep 15 12:09:28.150989 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:28.150960 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:28.223700 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:28.223665 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:28.377441 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:28.377391 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:28.475600 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:28.475567 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:28.577982 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:28.577951 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:28.758350 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:28.758272 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:28.869121 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:28.869091 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:29.065592 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:29.065505 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerStarted","Data":"7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d"} Sep 15 12:09:29.065592 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:29.065566 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerStarted","Data":"cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25"} Sep 15 12:09:31.078343 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.078271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerStarted","Data":"3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6"} Sep 15 12:09:31.078343 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.078334 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerStarted","Data":"83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205"} Sep 15 12:09:31.078687 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.078362 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerStarted","Data":"6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef"} Sep 15 12:09:31.078687 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.078399 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerStarted","Data":"d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72"} Sep 15 12:09:31.111503 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.111440 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.43538063 podStartE2EDuration="7.111419214s" totalImagesPullingTime="5.657207127s" totalInitContainerRuntime="18.831457ms" isStatefulPod=false podCreationTimestamp="2026-09-15 12:09:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:31.11077369 +0000 UTC m=+65.994968399" watchObservedRunningTime="2026-09-15 12:09:31.111419214 +0000 UTC m=+65.995613926" Sep 15 12:09:31.302738 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.302707 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:31.310794 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.310774 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d74z\" (UniqueName: \"kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z\") pod \"network-check-target-n2jfb\" (UID: \"4faba139-910e-4c25-83b8-41797f237bf8\") " pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:09:31.313232 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.313216 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 12:09:31.323858 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.323837 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 12:09:31.334480 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.334429 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d74z\" (UniqueName: \"kubernetes.io/projected/4faba139-910e-4c25-83b8-41797f237bf8-kube-api-access-7d74z\") pod \"network-check-target-n2jfb\" (UID: \"4faba139-910e-4c25-83b8-41797f237bf8\") " pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:09:31.403145 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.403115 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:31.411329 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.411305 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:09:31.411403 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.411363 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:09:31.413890 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.413873 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 12:09:31.413955 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.413916 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 12:09:31.424448 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.424426 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7b35aca-f916-427c-a664-c01548bdef0f-metrics-certs\") pod \"network-metrics-daemon-fqj7b\" (UID: \"b7b35aca-f916-427c-a664-c01548bdef0f\") " pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:09:31.424525 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.424458 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5224c06-9441-4fa1-9e01-bdcad9e209ca-original-pull-secret\") pod \"global-pull-secret-syncer-xqtr5\" (UID: \"c5224c06-9441-4fa1-9e01-bdcad9e209ca\") " pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:09:31.503845 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.503813 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:31.537781 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.537741 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxzl4\"" Sep 15 12:09:31.544969 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.544956 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:09:31.642231 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.642189 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqtr5" Sep 15 12:09:31.660674 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.660655 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qplds\"" Sep 15 12:09:31.668657 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.668637 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqj7b" Sep 15 12:09:31.816024 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.815996 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2jfb"] Sep 15 12:09:31.819079 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:31.819057 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4faba139_910e_4c25_83b8_41797f237bf8.slice/crio-6f8bfe28034975f5f9487faa59461b85d71b0d64c53b722b7f0e29e4e3fd69de WatchSource:0}: Error finding container 6f8bfe28034975f5f9487faa59461b85d71b0d64c53b722b7f0e29e4e3fd69de: Status 404 returned error can't find the container with id 6f8bfe28034975f5f9487faa59461b85d71b0d64c53b722b7f0e29e4e3fd69de Sep 15 12:09:31.910326 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.910305 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xqtr5"] Sep 15 12:09:31.912533 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:31.912515 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5224c06_9441_4fa1_9e01_bdcad9e209ca.slice/crio-0be46fa67c818fc5ee7ee83ad1ff2037f212a6d529aa7496eac4e8ffc8b4d753 WatchSource:0}: Error finding container 0be46fa67c818fc5ee7ee83ad1ff2037f212a6d529aa7496eac4e8ffc8b4d753: Status 404 returned error can't find the container with id 0be46fa67c818fc5ee7ee83ad1ff2037f212a6d529aa7496eac4e8ffc8b4d753 Sep 15 12:09:31.948648 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:31.948617 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fqj7b"] Sep 15 12:09:31.954223 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:09:31.954199 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b35aca_f916_427c_a664_c01548bdef0f.slice/crio-d0eff80be3ef7025e70edc36a35a72157cf3dd09d28e4edbb858887333857d80 WatchSource:0}: Error finding container d0eff80be3ef7025e70edc36a35a72157cf3dd09d28e4edbb858887333857d80: Status 404 returned error can't find the container with id d0eff80be3ef7025e70edc36a35a72157cf3dd09d28e4edbb858887333857d80 Sep 15 12:09:32.082827 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:32.082789 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2jfb" event={"ID":"4faba139-910e-4c25-83b8-41797f237bf8","Type":"ContainerStarted","Data":"6f8bfe28034975f5f9487faa59461b85d71b0d64c53b722b7f0e29e4e3fd69de"} Sep 15 12:09:32.083975 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:32.083949 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fqj7b" event={"ID":"b7b35aca-f916-427c-a664-c01548bdef0f","Type":"ContainerStarted","Data":"d0eff80be3ef7025e70edc36a35a72157cf3dd09d28e4edbb858887333857d80"} Sep 15 12:09:32.084941 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:32.084917 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xqtr5" event={"ID":"c5224c06-9441-4fa1-9e01-bdcad9e209ca","Type":"ContainerStarted","Data":"0be46fa67c818fc5ee7ee83ad1ff2037f212a6d529aa7496eac4e8ffc8b4d753"} Sep 15 12:09:32.890853 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:32.890811 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:32.891044 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:32.890937 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:32.896645 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:32.896614 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:33.092230 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:33.092201 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fqj7b" event={"ID":"b7b35aca-f916-427c-a664-c01548bdef0f","Type":"ContainerStarted","Data":"a28b6f79e972ff58567cff1e83fdae1baffcbfea70cb3a3f13209f6481ce5c4c"} Sep 15 12:09:33.097069 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:33.097041 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:09:33.168178 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:33.168071 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54d47c8b87-mlv4p"] Sep 15 12:09:33.300512 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:33.300472 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:33.398214 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:33.398175 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:33.499334 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:33.499301 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:34.102574 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:34.102520 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fqj7b" event={"ID":"b7b35aca-f916-427c-a664-c01548bdef0f","Type":"ContainerStarted","Data":"9365a536849fd43e70b2077ae7992bdc6676f3267e4a2fdc02265825743287e8"} Sep 15 12:09:34.123619 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:34.123562 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fqj7b" podStartSLOduration=67.180847219 podStartE2EDuration="1m8.123538249s" totalImagesPullingTime="942.69103ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:34.120980543 +0000 UTC m=+69.005175265" watchObservedRunningTime="2026-09-15 12:09:34.123538249 +0000 UTC m=+69.007732959" Sep 15 12:09:34.223056 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:34.222985 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:34.297355 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:34.297295 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:34.400332 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:34.400248 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:34.701531 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:34.701442 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:34.779173 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:34.779138 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:35.602033 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:35.601992 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:35.730879 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:35.730847 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:37.116965 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:37.116927 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xqtr5" event={"ID":"c5224c06-9441-4fa1-9e01-bdcad9e209ca","Type":"ContainerStarted","Data":"359b687fbdd1fa288b90c665b7c19fd144d0d4b29954809db9dcf86502cd4b99"} Sep 15 12:09:37.118613 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:37.118585 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2jfb" event={"ID":"4faba139-910e-4c25-83b8-41797f237bf8","Type":"ContainerStarted","Data":"fa373491f043930bbc0173b24f56318fcc01323e5c24f713b470a9211aeae650"} Sep 15 12:09:37.118716 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:37.118666 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:09:37.131482 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:37.131431 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xqtr5" podStartSLOduration=66.390175578 podStartE2EDuration="1m11.131414119s" totalImagesPullingTime="4.741238541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:37.130733476 +0000 UTC m=+72.014928186" watchObservedRunningTime="2026-09-15 12:09:37.131414119 +0000 UTC m=+72.015608828" Sep 15 12:09:37.146892 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:37.146850 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n2jfb" podStartSLOduration=66.316208878 podStartE2EDuration="1m11.146834078s" totalImagesPullingTime="4.8306252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:37.146003483 +0000 UTC m=+72.030198193" watchObservedRunningTime="2026-09-15 12:09:37.146834078 +0000 UTC m=+72.031028786" Sep 15 12:09:37.446542 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:37.446458 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:37.523807 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:37.523741 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:37.595664 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:37.595634 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:43.109793 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:43.109734 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:43.178716 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:43.178685 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:43.193661 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:43.193637 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:09:47.547695 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.547619 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-868c5566fd-4ms6p" podUID="9b46e68e-a11d-44f9-b06e-b3a6edf0013a" containerName="console" containerID="cri-o://e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb" gracePeriod=15 Sep 15 12:09:47.785216 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.785192 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:47.853708 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.853625 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-service-ca\") pod \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " Sep 15 12:09:47.853708 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.853670 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-serving-cert\") pod \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " Sep 15 12:09:47.853708 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.853689 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-trusted-ca-bundle\") pod \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " Sep 15 12:09:47.854006 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.853737 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-config\") pod \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " Sep 15 12:09:47.854006 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.853805 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t9tr\" (UniqueName: \"kubernetes.io/projected/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-kube-api-access-9t9tr\") pod \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " Sep 15 12:09:47.854154 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.854126 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9b46e68e-a11d-44f9-b06e-b3a6edf0013a" (UID: "9b46e68e-a11d-44f9-b06e-b3a6edf0013a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:09:47.854214 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.853836 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-oauth-serving-cert\") pod \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " Sep 15 12:09:47.854276 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.854216 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-oauth-config\") pod \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\" (UID: \"9b46e68e-a11d-44f9-b06e-b3a6edf0013a\") " Sep 15 12:09:47.854376 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.854208 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-service-ca" (OuterVolumeSpecName: "service-ca") pod "9b46e68e-a11d-44f9-b06e-b3a6edf0013a" (UID: "9b46e68e-a11d-44f9-b06e-b3a6edf0013a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:09:47.854472 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.854437 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9b46e68e-a11d-44f9-b06e-b3a6edf0013a" (UID: "9b46e68e-a11d-44f9-b06e-b3a6edf0013a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:09:47.854472 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.854468 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-service-ca\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:47.854569 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.854487 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-trusted-ca-bundle\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:47.854661 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.854638 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-config" (OuterVolumeSpecName: "console-config") pod "9b46e68e-a11d-44f9-b06e-b3a6edf0013a" (UID: "9b46e68e-a11d-44f9-b06e-b3a6edf0013a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:09:47.856345 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.856324 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9b46e68e-a11d-44f9-b06e-b3a6edf0013a" (UID: "9b46e68e-a11d-44f9-b06e-b3a6edf0013a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:09:47.856442 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.856392 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-kube-api-access-9t9tr" (OuterVolumeSpecName: "kube-api-access-9t9tr") pod "9b46e68e-a11d-44f9-b06e-b3a6edf0013a" (UID: "9b46e68e-a11d-44f9-b06e-b3a6edf0013a"). InnerVolumeSpecName "kube-api-access-9t9tr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:09:47.856442 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.856404 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9b46e68e-a11d-44f9-b06e-b3a6edf0013a" (UID: "9b46e68e-a11d-44f9-b06e-b3a6edf0013a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:09:47.955898 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.955785 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:47.955898 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.955815 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t9tr\" (UniqueName: \"kubernetes.io/projected/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-kube-api-access-9t9tr\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:47.955898 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.955826 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-oauth-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:47.955898 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.955835 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-oauth-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:47.955898 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:47.955843 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b46e68e-a11d-44f9-b06e-b3a6edf0013a-console-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:48.164601 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:48.164510 2554 generic.go:356] "Generic (PLEG): container finished" podID="9b46e68e-a11d-44f9-b06e-b3a6edf0013a" containerID="e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb" exitCode=0 Sep 15 12:09:48.164601 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:48.164561 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868c5566fd-4ms6p" Sep 15 12:09:48.164601 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:48.164589 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868c5566fd-4ms6p" event={"ID":"9b46e68e-a11d-44f9-b06e-b3a6edf0013a","Type":"ContainerDied","Data":"e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb"} Sep 15 12:09:48.164840 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:48.164637 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868c5566fd-4ms6p" event={"ID":"9b46e68e-a11d-44f9-b06e-b3a6edf0013a","Type":"ContainerDied","Data":"2a8414cc5f589e195b7f44a746f9cfc0c9730430ac151b4e18319b3882b513b9"} Sep 15 12:09:48.164840 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:48.164665 2554 scope.go:117] "RemoveContainer" containerID="e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb" Sep 15 12:09:48.173456 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:48.173441 2554 scope.go:117] "RemoveContainer" containerID="e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb" Sep 15 12:09:48.173758 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:48.173715 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb\": container with ID starting with e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb not found: ID does not exist" containerID="e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb" Sep 15 12:09:48.173807 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:48.173766 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb"} err="failed to get container status \"e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb\": rpc error: code = NotFound desc = could not find container \"e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb\": container with ID starting with e665d2c252f3badea6e5b96f985ce696c938f7e45200b544c7df1139e1b4c3cb not found: ID does not exist" Sep 15 12:09:48.185940 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:48.185915 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868c5566fd-4ms6p"] Sep 15 12:09:48.189153 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:48.189131 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-868c5566fd-4ms6p"] Sep 15 12:09:49.713507 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:49.713471 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:49.729190 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:49.729161 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b46e68e-a11d-44f9-b06e-b3a6edf0013a" path="/var/lib/kubelet/pods/9b46e68e-a11d-44f9-b06e-b3a6edf0013a/volumes" Sep 15 12:09:49.785482 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:49.785454 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:09:58.192608 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.192539 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54d47c8b87-mlv4p" podUID="1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" containerName="console" containerID="cri-o://7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41" gracePeriod=15 Sep 15 12:09:58.433838 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.433812 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:58.546901 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.546875 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-serving-cert\") pod \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " Sep 15 12:09:58.546901 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.546905 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77qns\" (UniqueName: \"kubernetes.io/projected/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-kube-api-access-77qns\") pod \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " Sep 15 12:09:58.547135 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.546965 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-oauth-serving-cert\") pod \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " Sep 15 12:09:58.547135 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.546983 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-config\") pod \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " Sep 15 12:09:58.547135 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.547013 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-oauth-config\") pod \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " Sep 15 12:09:58.547285 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.547179 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-service-ca\") pod \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\" (UID: \"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48\") " Sep 15 12:09:58.547383 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.547351 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" (UID: "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:09:58.547460 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.547383 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-config" (OuterVolumeSpecName: "console-config") pod "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" (UID: "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:09:58.547460 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.547453 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-oauth-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:58.547541 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.547468 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:58.547696 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.547671 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-service-ca" (OuterVolumeSpecName: "service-ca") pod "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" (UID: "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:09:58.549227 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.549194 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" (UID: "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:09:58.549334 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.549252 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-kube-api-access-77qns" (OuterVolumeSpecName: "kube-api-access-77qns") pod "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" (UID: "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48"). InnerVolumeSpecName "kube-api-access-77qns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:09:58.549334 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.549266 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" (UID: "1bd5d5b3-fa43-40e0-9264-e4e065a7fb48"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:09:58.648393 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.648364 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-service-ca\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:58.648393 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.648388 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:58.648543 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.648398 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77qns\" (UniqueName: \"kubernetes.io/projected/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-kube-api-access-77qns\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:58.648543 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:58.648407 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48-console-oauth-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:09:59.207391 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:59.207354 2554 generic.go:356] "Generic (PLEG): container finished" podID="1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" containerID="7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41" exitCode=0 Sep 15 12:09:59.207823 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:59.207396 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d47c8b87-mlv4p" Sep 15 12:09:59.207823 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:59.207442 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d47c8b87-mlv4p" event={"ID":"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48","Type":"ContainerDied","Data":"7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41"} Sep 15 12:09:59.207823 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:59.207493 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d47c8b87-mlv4p" event={"ID":"1bd5d5b3-fa43-40e0-9264-e4e065a7fb48","Type":"ContainerDied","Data":"b013f02193614a0b6ffea11abb05e2a8c8faeaf70d1116f52efae0e1a6b3acbc"} Sep 15 12:09:59.207823 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:59.207513 2554 scope.go:117] "RemoveContainer" containerID="7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41" Sep 15 12:09:59.215609 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:59.215593 2554 scope.go:117] "RemoveContainer" containerID="7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41" Sep 15 12:09:59.215874 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:09:59.215857 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41\": container with ID starting with 7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41 not found: ID does not exist" containerID="7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41" Sep 15 12:09:59.215924 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:59.215881 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41"} err="failed to get container status \"7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41\": rpc error: code = NotFound desc = could not find container \"7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41\": container with ID starting with 7c0d696ffa667ce5c6908488cc3058f1e0ae2159e8eab773744b403b524a7c41 not found: ID does not exist" Sep 15 12:09:59.228461 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:59.228440 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54d47c8b87-mlv4p"] Sep 15 12:09:59.234415 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:59.234393 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54d47c8b87-mlv4p"] Sep 15 12:09:59.729249 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:09:59.729218 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" path="/var/lib/kubelet/pods/1bd5d5b3-fa43-40e0-9264-e4e065a7fb48/volumes" Sep 15 12:10:06.411514 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:06.411461 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:10:06.683417 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:06.683310 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:10:07.471552 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:07.471503 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:10:07.471971 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:07.471921 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="alertmanager" containerID="cri-o://fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e" gracePeriod=120 Sep 15 12:10:07.471971 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:07.471955 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy-web" containerID="cri-o://19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090" gracePeriod=120 Sep 15 12:10:07.472076 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:07.471966 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy-metric" containerID="cri-o://4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16" gracePeriod=120 Sep 15 12:10:07.472076 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:07.471967 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy" containerID="cri-o://3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5" gracePeriod=120 Sep 15 12:10:07.472175 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:07.472079 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="config-reloader" containerID="cri-o://677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad" gracePeriod=120 Sep 15 12:10:07.472230 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:07.472161 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="prom-label-proxy" containerID="cri-o://cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b" gracePeriod=120 Sep 15 12:10:08.125827 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.125800 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n2jfb" Sep 15 12:10:08.246388 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.246351 2554 generic.go:356] "Generic (PLEG): container finished" podID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerID="cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b" exitCode=0 Sep 15 12:10:08.246388 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.246383 2554 generic.go:356] "Generic (PLEG): container finished" podID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerID="4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16" exitCode=0 Sep 15 12:10:08.246388 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.246393 2554 generic.go:356] "Generic (PLEG): container finished" podID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerID="3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5" exitCode=0 Sep 15 12:10:08.246388 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.246403 2554 generic.go:356] "Generic (PLEG): container finished" podID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerID="677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad" exitCode=0 Sep 15 12:10:08.246656 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.246413 2554 generic.go:356] "Generic (PLEG): container finished" podID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerID="fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e" exitCode=0 Sep 15 12:10:08.246656 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.246412 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerDied","Data":"cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b"} Sep 15 12:10:08.246656 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.246477 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerDied","Data":"4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16"} Sep 15 12:10:08.246656 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.246505 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerDied","Data":"3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5"} Sep 15 12:10:08.246656 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.246529 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerDied","Data":"677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad"} Sep 15 12:10:08.246656 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.246571 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerDied","Data":"fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e"} Sep 15 12:10:08.783995 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.783964 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:08.839494 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.839057 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-main-tls\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.839798 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.839776 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-tls-assets\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.839917 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.839838 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-web\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.839917 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.839872 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-metrics-client-ca\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.840029 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.839917 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-main-db\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.840029 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.839949 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-config-volume\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.840029 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.839990 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-config-out\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.840029 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.840020 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-trusted-ca-bundle\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.840232 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.840080 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76jwd\" (UniqueName: \"kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-kube-api-access-76jwd\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.840232 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.840142 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-web-config\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.840232 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.840171 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.840232 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.840215 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-metric\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.840423 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.840244 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-cluster-tls-config\") pod \"07e936bd-8b4f-44ab-a264-0a29c6669def\" (UID: \"07e936bd-8b4f-44ab-a264-0a29c6669def\") " Sep 15 12:10:08.840715 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.840679 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 12:10:08.841026 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.840996 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:08.842562 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.842380 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:08.847180 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.847143 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:10:08.847571 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.847453 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:08.847571 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.847669 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-config-out" (OuterVolumeSpecName: "config-out") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 12:10:08.847571 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.847678 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:08.847945 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.847831 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:08.848267 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.848188 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-config-volume" (OuterVolumeSpecName: "config-volume") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:08.848402 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.848288 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-kube-api-access-76jwd" (OuterVolumeSpecName: "kube-api-access-76jwd") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "kube-api-access-76jwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:10:08.848402 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.848372 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:08.853566 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.852273 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:08.860528 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.860493 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-web-config" (OuterVolumeSpecName: "web-config") pod "07e936bd-8b4f-44ab-a264-0a29c6669def" (UID: "07e936bd-8b4f-44ab-a264-0a29c6669def"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:08.950105 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950073 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-web-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950105 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950106 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950121 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950134 2554 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-cluster-tls-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950146 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-main-tls\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950157 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-tls-assets\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950169 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950180 2554 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-metrics-client-ca\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950191 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-main-db\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950203 2554 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07e936bd-8b4f-44ab-a264-0a29c6669def-config-volume\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950215 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07e936bd-8b4f-44ab-a264-0a29c6669def-config-out\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950226 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e936bd-8b4f-44ab-a264-0a29c6669def-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:08.950316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:08.950239 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76jwd\" (UniqueName: \"kubernetes.io/projected/07e936bd-8b4f-44ab-a264-0a29c6669def-kube-api-access-76jwd\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:09.253151 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.253116 2554 generic.go:356] "Generic (PLEG): container finished" podID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerID="19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090" exitCode=0 Sep 15 12:10:09.253361 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.253167 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerDied","Data":"19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090"} Sep 15 12:10:09.253361 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.253196 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.253361 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.253237 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07e936bd-8b4f-44ab-a264-0a29c6669def","Type":"ContainerDied","Data":"9d5e72e54cc83a32455cf77001a0c5bec7a425af45b341d18190e126ba988500"} Sep 15 12:10:09.253361 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.253270 2554 scope.go:117] "RemoveContainer" containerID="cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b" Sep 15 12:10:09.261392 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.261254 2554 scope.go:117] "RemoveContainer" containerID="4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16" Sep 15 12:10:09.268096 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.268079 2554 scope.go:117] "RemoveContainer" containerID="3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5" Sep 15 12:10:09.274559 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.274544 2554 scope.go:117] "RemoveContainer" containerID="19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090" Sep 15 12:10:09.277098 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.277074 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:10:09.282154 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.282134 2554 scope.go:117] "RemoveContainer" containerID="677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad" Sep 15 12:10:09.282253 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.282232 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:10:09.288586 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.288569 2554 scope.go:117] "RemoveContainer" containerID="fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e" Sep 15 12:10:09.295109 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.295094 2554 scope.go:117] "RemoveContainer" containerID="077b0875c42b6d53493a94b7e49cf424745e6b04b37d2722af565ba7ac0c6d8b" Sep 15 12:10:09.301489 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.301472 2554 scope.go:117] "RemoveContainer" containerID="cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b" Sep 15 12:10:09.301795 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:09.301771 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b\": container with ID starting with cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b not found: ID does not exist" containerID="cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b" Sep 15 12:10:09.301866 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.301805 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b"} err="failed to get container status \"cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b\": rpc error: code = NotFound desc = could not find container \"cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b\": container with ID starting with cd663cef9a7cae13f9f29514e68c9bd500229bec2fbbbb1c76bca5c53496081b not found: ID does not exist" Sep 15 12:10:09.301866 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.301827 2554 scope.go:117] "RemoveContainer" containerID="4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16" Sep 15 12:10:09.302077 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:09.302060 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16\": container with ID starting with 4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16 not found: ID does not exist" containerID="4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16" Sep 15 12:10:09.302116 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.302083 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16"} err="failed to get container status \"4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16\": rpc error: code = NotFound desc = could not find container \"4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16\": container with ID starting with 4731b2907055261a71f07e3327499349c336d14c1ab1db3c6eddfa1086484f16 not found: ID does not exist" Sep 15 12:10:09.302116 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.302098 2554 scope.go:117] "RemoveContainer" containerID="3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5" Sep 15 12:10:09.302359 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:09.302343 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5\": container with ID starting with 3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5 not found: ID does not exist" containerID="3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5" Sep 15 12:10:09.302394 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.302364 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5"} err="failed to get container status \"3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5\": rpc error: code = NotFound desc = could not find container \"3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5\": container with ID starting with 3dc32d2b8ad17224ef9777f6c1714cd66cdaf64af122d69ada62fb15649477c5 not found: ID does not exist" Sep 15 12:10:09.302394 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.302377 2554 scope.go:117] "RemoveContainer" containerID="19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090" Sep 15 12:10:09.302609 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:09.302593 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090\": container with ID starting with 19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090 not found: ID does not exist" containerID="19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090" Sep 15 12:10:09.302653 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.302612 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090"} err="failed to get container status \"19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090\": rpc error: code = NotFound desc = could not find container \"19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090\": container with ID starting with 19cf3a65d678ac02978d6adc3837055f8c8be0bfe17dfb3ef048c6ab1f33c090 not found: ID does not exist" Sep 15 12:10:09.302653 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.302631 2554 scope.go:117] "RemoveContainer" containerID="677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad" Sep 15 12:10:09.302871 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:09.302856 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad\": container with ID starting with 677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad not found: ID does not exist" containerID="677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad" Sep 15 12:10:09.302918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.302875 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad"} err="failed to get container status \"677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad\": rpc error: code = NotFound desc = could not find container \"677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad\": container with ID starting with 677d98420504c0a212c332cf2ab52112b8c3039c5fea0dcebc1227cebabfe9ad not found: ID does not exist" Sep 15 12:10:09.302918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.302889 2554 scope.go:117] "RemoveContainer" containerID="fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e" Sep 15 12:10:09.303137 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:09.303121 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e\": container with ID starting with fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e not found: ID does not exist" containerID="fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e" Sep 15 12:10:09.303177 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.303141 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e"} err="failed to get container status \"fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e\": rpc error: code = NotFound desc = could not find container \"fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e\": container with ID starting with fa08bef26bd102b2891408b3f3b418ec241bd5396d687cba0c76034335d2323e not found: ID does not exist" Sep 15 12:10:09.303177 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.303156 2554 scope.go:117] "RemoveContainer" containerID="077b0875c42b6d53493a94b7e49cf424745e6b04b37d2722af565ba7ac0c6d8b" Sep 15 12:10:09.303383 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:09.303366 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"077b0875c42b6d53493a94b7e49cf424745e6b04b37d2722af565ba7ac0c6d8b\": container with ID starting with 077b0875c42b6d53493a94b7e49cf424745e6b04b37d2722af565ba7ac0c6d8b not found: ID does not exist" containerID="077b0875c42b6d53493a94b7e49cf424745e6b04b37d2722af565ba7ac0c6d8b" Sep 15 12:10:09.303414 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.303387 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"077b0875c42b6d53493a94b7e49cf424745e6b04b37d2722af565ba7ac0c6d8b"} err="failed to get container status \"077b0875c42b6d53493a94b7e49cf424745e6b04b37d2722af565ba7ac0c6d8b\": rpc error: code = NotFound desc = could not find container \"077b0875c42b6d53493a94b7e49cf424745e6b04b37d2722af565ba7ac0c6d8b\": container with ID starting with 077b0875c42b6d53493a94b7e49cf424745e6b04b37d2722af565ba7ac0c6d8b not found: ID does not exist" Sep 15 12:10:09.315540 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315520 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:10:09.315775 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315763 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="init-config-reloader" Sep 15 12:10:09.315822 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315778 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="init-config-reloader" Sep 15 12:10:09.315822 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315789 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" containerName="console" Sep 15 12:10:09.315822 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315794 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" containerName="console" Sep 15 12:10:09.315822 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315804 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="config-reloader" Sep 15 12:10:09.315822 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315809 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="config-reloader" Sep 15 12:10:09.315822 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315815 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy-web" Sep 15 12:10:09.315822 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315820 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy-web" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315831 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b46e68e-a11d-44f9-b06e-b3a6edf0013a" containerName="console" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315836 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b46e68e-a11d-44f9-b06e-b3a6edf0013a" containerName="console" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315844 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="prom-label-proxy" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315849 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="prom-label-proxy" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315856 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315861 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315866 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy-metric" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315871 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy-metric" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315879 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="alertmanager" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315884 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="alertmanager" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315924 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b46e68e-a11d-44f9-b06e-b3a6edf0013a" containerName="console" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315931 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy-metric" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315937 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="prom-label-proxy" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315943 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315949 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bd5d5b3-fa43-40e0-9264-e4e065a7fb48" containerName="console" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315954 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="config-reloader" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315959 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="kube-rbac-proxy-web" Sep 15 12:10:09.316059 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.315966 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" containerName="alertmanager" Sep 15 12:10:09.350024 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.349998 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:10:09.350146 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.350130 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.352897 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.352875 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 15 12:10:09.353319 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.353300 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-54wbn\"" Sep 15 12:10:09.353539 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.353525 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 15 12:10:09.353619 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.353554 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 15 12:10:09.354015 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.353996 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 15 12:10:09.354088 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.354016 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 15 12:10:09.354088 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.354036 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 15 12:10:09.355009 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.354579 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 15 12:10:09.355009 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.354844 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 15 12:10:09.361523 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.361504 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 15 12:10:09.453534 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453510 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.453670 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453538 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.453670 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453556 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd6lw\" (UniqueName: \"kubernetes.io/projected/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-kube-api-access-qd6lw\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.453670 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453574 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.453670 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453654 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.453845 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453680 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-web-config\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.453845 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453709 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-config-volume\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.453845 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453737 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.453845 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.453845 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.453845 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453838 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.454030 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453854 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.454030 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.453874 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-config-out\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555035 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.554971 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-config-volume\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555035 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555004 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555035 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555027 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555071 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555111 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-config-out\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555147 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555161 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555184 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd6lw\" (UniqueName: \"kubernetes.io/projected/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-kube-api-access-qd6lw\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555211 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555238 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-web-config\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.555975 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.555947 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.556077 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.556020 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.557571 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.557541 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.558097 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.558051 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-config-volume\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.558097 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.558080 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-web-config\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.558248 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.558154 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.558248 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.558184 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.558511 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.558492 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.558671 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.558653 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.558799 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.558781 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.558861 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.558805 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-config-out\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.559935 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.559919 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.565496 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.565478 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd6lw\" (UniqueName: \"kubernetes.io/projected/838872b0-d9e1-4d78-b43c-fc3b00f8ce31-kube-api-access-qd6lw\") pod \"alertmanager-main-0\" (UID: \"838872b0-d9e1-4d78-b43c-fc3b00f8ce31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.662850 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.662824 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:10:09.730389 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.730357 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e936bd-8b4f-44ab-a264-0a29c6669def" path="/var/lib/kubelet/pods/07e936bd-8b4f-44ab-a264-0a29c6669def/volumes" Sep 15 12:10:09.976180 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:09.976152 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:10:09.979046 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:10:09.979024 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838872b0_d9e1_4d78_b43c_fc3b00f8ce31.slice/crio-54a0847465a160dc127d6af1f166f9cd02cfc39f0d7ff5390e59e8dc35a27bc4 WatchSource:0}: Error finding container 54a0847465a160dc127d6af1f166f9cd02cfc39f0d7ff5390e59e8dc35a27bc4: Status 404 returned error can't find the container with id 54a0847465a160dc127d6af1f166f9cd02cfc39f0d7ff5390e59e8dc35a27bc4 Sep 15 12:10:10.258987 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:10.258903 2554 generic.go:356] "Generic (PLEG): container finished" podID="838872b0-d9e1-4d78-b43c-fc3b00f8ce31" containerID="c9507de545237f9e5e43d639328c91df3ccdd0551a20a7f7011b7156bda5b3f4" exitCode=0 Sep 15 12:10:10.258987 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:10.258964 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"838872b0-d9e1-4d78-b43c-fc3b00f8ce31","Type":"ContainerDied","Data":"c9507de545237f9e5e43d639328c91df3ccdd0551a20a7f7011b7156bda5b3f4"} Sep 15 12:10:10.259156 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:10.259032 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"838872b0-d9e1-4d78-b43c-fc3b00f8ce31","Type":"ContainerStarted","Data":"54a0847465a160dc127d6af1f166f9cd02cfc39f0d7ff5390e59e8dc35a27bc4"} Sep 15 12:10:11.265885 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.265849 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"838872b0-d9e1-4d78-b43c-fc3b00f8ce31","Type":"ContainerStarted","Data":"5a5e2cb3c83bceee4bcbd10e7a20272677257ea1967a26a18dae6b4088813abb"} Sep 15 12:10:11.266240 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.265936 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"838872b0-d9e1-4d78-b43c-fc3b00f8ce31","Type":"ContainerStarted","Data":"9b551776f164fe4d269427e10615aff34ea778a3e03adbe05a0ba21f3b550b3e"} Sep 15 12:10:11.266240 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.265968 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"838872b0-d9e1-4d78-b43c-fc3b00f8ce31","Type":"ContainerStarted","Data":"3e740b80304bb6b1249149e607f6217d1d1c1460538b8964d31fb985aae24b80"} Sep 15 12:10:11.266240 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.266007 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"838872b0-d9e1-4d78-b43c-fc3b00f8ce31","Type":"ContainerStarted","Data":"ca435ae09fcca51125c31fbddb7512ed74d7f06cd86cb313bb37dddfd7a22a02"} Sep 15 12:10:11.266240 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.266031 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"838872b0-d9e1-4d78-b43c-fc3b00f8ce31","Type":"ContainerStarted","Data":"70c531b1ea1c4dd0dea6ccebd049107423e5b6af67071a6320c3028c354957bf"} Sep 15 12:10:11.266240 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.266053 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"838872b0-d9e1-4d78-b43c-fc3b00f8ce31","Type":"ContainerStarted","Data":"e2f0b3cf331ac799e32354e0185a10ca8bdfdeb765ac35fbcbc828412a59d5fc"} Sep 15 12:10:11.297307 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.297266 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.2759832749999998 podStartE2EDuration="2.297247884s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.264609ms" isStatefulPod=false podCreationTimestamp="2026-09-15 12:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:10:11.295662171 +0000 UTC m=+106.179856880" watchObservedRunningTime="2026-09-15 12:10:11.297247884 +0000 UTC m=+106.181442593" Sep 15 12:10:11.516374 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.516338 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-95d75fbd9-zj8gf"] Sep 15 12:10:11.518945 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.518922 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.521510 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.521483 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 15 12:10:11.521631 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.521575 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gz6tj\"" Sep 15 12:10:11.521631 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.521581 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 15 12:10:11.521631 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.521588 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 15 12:10:11.521631 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.521625 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 15 12:10:11.521888 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.521863 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 15 12:10:11.529047 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.529025 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 15 12:10:11.540039 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.540016 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-95d75fbd9-zj8gf"] Sep 15 12:10:11.572592 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.572562 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grmxk\" (UniqueName: \"kubernetes.io/projected/2d737cca-780b-425e-86b5-013dd051ac52-kube-api-access-grmxk\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.572691 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.572604 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-secret-telemeter-client\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.572691 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.572629 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d737cca-780b-425e-86b5-013dd051ac52-serving-certs-ca-bundle\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.572691 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.572675 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.572839 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.572718 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d737cca-780b-425e-86b5-013dd051ac52-telemeter-trusted-ca-bundle\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.572839 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.572795 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-telemeter-client-tls\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.572839 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.572821 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-federate-client-tls\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.572937 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.572867 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d737cca-780b-425e-86b5-013dd051ac52-metrics-client-ca\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.674164 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.674130 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d737cca-780b-425e-86b5-013dd051ac52-metrics-client-ca\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.674406 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.674386 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grmxk\" (UniqueName: \"kubernetes.io/projected/2d737cca-780b-425e-86b5-013dd051ac52-kube-api-access-grmxk\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.674521 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.674508 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-secret-telemeter-client\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.674625 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.674612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d737cca-780b-425e-86b5-013dd051ac52-serving-certs-ca-bundle\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.674720 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.674707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.674831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.674818 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d737cca-780b-425e-86b5-013dd051ac52-telemeter-trusted-ca-bundle\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.674938 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.674914 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-telemeter-client-tls\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.675044 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.674957 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-federate-client-tls\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.675044 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.674994 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d737cca-780b-425e-86b5-013dd051ac52-metrics-client-ca\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.675612 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.675581 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d737cca-780b-425e-86b5-013dd051ac52-serving-certs-ca-bundle\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.675822 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.675799 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d737cca-780b-425e-86b5-013dd051ac52-telemeter-trusted-ca-bundle\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.677444 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.677419 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-federate-client-tls\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.677539 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.677506 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.677603 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.677512 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-telemeter-client-tls\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.677771 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.677735 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d737cca-780b-425e-86b5-013dd051ac52-secret-telemeter-client\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.683990 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.683965 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grmxk\" (UniqueName: \"kubernetes.io/projected/2d737cca-780b-425e-86b5-013dd051ac52-kube-api-access-grmxk\") pod \"telemeter-client-95d75fbd9-zj8gf\" (UID: \"2d737cca-780b-425e-86b5-013dd051ac52\") " pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:11.795204 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.795129 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:10:11.795622 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.795457 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="thanos-sidecar" containerID="cri-o://d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72" gracePeriod=600 Sep 15 12:10:11.795622 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.795453 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy-web" containerID="cri-o://6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef" gracePeriod=600 Sep 15 12:10:11.795622 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.795470 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="config-reloader" containerID="cri-o://7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d" gracePeriod=600 Sep 15 12:10:11.795622 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.795490 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy" containerID="cri-o://83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205" gracePeriod=600 Sep 15 12:10:11.795622 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.795442 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="prometheus" containerID="cri-o://cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25" gracePeriod=600 Sep 15 12:10:11.795622 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.795455 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6" gracePeriod=600 Sep 15 12:10:11.828880 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:11.828854 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" Sep 15 12:10:12.123687 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.123654 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-95d75fbd9-zj8gf"] Sep 15 12:10:12.128862 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:10:12.128836 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d737cca_780b_425e_86b5_013dd051ac52.slice/crio-9d1510b3913f4b13cb4f56339f1182b0db808904262424eb2ea323ddc94e103e WatchSource:0}: Error finding container 9d1510b3913f4b13cb4f56339f1182b0db808904262424eb2ea323ddc94e103e: Status 404 returned error can't find the container with id 9d1510b3913f4b13cb4f56339f1182b0db808904262424eb2ea323ddc94e103e Sep 15 12:10:12.272958 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.272924 2554 generic.go:356] "Generic (PLEG): container finished" podID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerID="3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6" exitCode=0 Sep 15 12:10:12.272958 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.272950 2554 generic.go:356] "Generic (PLEG): container finished" podID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerID="83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205" exitCode=0 Sep 15 12:10:12.272958 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.272956 2554 generic.go:356] "Generic (PLEG): container finished" podID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerID="d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72" exitCode=0 Sep 15 12:10:12.272958 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.272961 2554 generic.go:356] "Generic (PLEG): container finished" podID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerID="7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d" exitCode=0 Sep 15 12:10:12.272958 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.272966 2554 generic.go:356] "Generic (PLEG): container finished" podID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerID="cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25" exitCode=0 Sep 15 12:10:12.273538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.272995 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerDied","Data":"3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6"} Sep 15 12:10:12.273538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.273116 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerDied","Data":"83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205"} Sep 15 12:10:12.273538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.273160 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerDied","Data":"d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72"} Sep 15 12:10:12.273538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.273202 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerDied","Data":"7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d"} Sep 15 12:10:12.273538 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.273243 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerDied","Data":"cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25"} Sep 15 12:10:12.274217 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:12.274197 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" event={"ID":"2d737cca-780b-425e-86b5-013dd051ac52","Type":"ContainerStarted","Data":"9d1510b3913f4b13cb4f56339f1182b0db808904262424eb2ea323ddc94e103e"} Sep 15 12:10:13.041666 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.041642 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.086638 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.086607 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-1\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.086849 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.086669 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm9jh\" (UniqueName: \"kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-kube-api-access-vm9jh\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.086849 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.086700 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-serving-certs-ca-bundle\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.086849 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.086729 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-tls\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.086849 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.086782 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-db\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.086849 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.086807 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-kube-rbac-proxy\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.086849 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.086847 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-grpc-tls\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.086892 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-trusted-ca-bundle\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.086917 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config-out\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.086942 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-tls-assets\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.086981 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-2\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.087013 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-metrics-client-ca\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.087031 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.087024 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.087062 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-metrics-client-certs\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.087089 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.087141 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-0\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.087168 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-kubelet-serving-ca-bundle\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087203 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.087207 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-web-config\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087839 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.087233 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-thanos-prometheus-http-client-file\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087839 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.087267 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\" (UID: \"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9\") " Sep 15 12:10:13.087839 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.087506 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.088341 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.088312 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:13.089918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.089889 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:13.092158 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.092130 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:13.094113 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.093972 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 12:10:13.094113 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.094020 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:13.094113 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.094049 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:13.094113 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.094098 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:13.094868 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.094440 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:13.094959 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.094882 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:13.095031 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.094980 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:13.095435 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.095259 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:13.095435 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.095349 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:13.097960 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.097564 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-kube-api-access-vm9jh" (OuterVolumeSpecName: "kube-api-access-vm9jh") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "kube-api-access-vm9jh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:10:13.100624 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.100541 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:13.100742 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.100720 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:13.100831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.100786 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config-out" (OuterVolumeSpecName: "config-out") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 12:10:13.100831 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.100798 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:10:13.102262 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.102240 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config" (OuterVolumeSpecName: "config") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:13.110051 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.110023 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-web-config" (OuterVolumeSpecName: "web-config") pod "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" (UID: "f574348a-e5e6-4c03-9d6d-d1494f2f3ed9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:13.188545 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188515 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-metrics-client-ca\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188545 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188542 2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188554 2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-metrics-client-certs\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188564 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188573 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188581 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188590 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-web-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188598 2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188608 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188616 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm9jh\" (UniqueName: \"kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-kube-api-access-vm9jh\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188624 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188632 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188641 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-db\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188649 2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-kube-rbac-proxy\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188658 2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-secret-grpc-tls\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188666 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188676 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-config-out\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188686 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-tls-assets\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.188722 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.188699 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:13.282727 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.282639 2554 generic.go:356] "Generic (PLEG): container finished" podID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerID="6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef" exitCode=0 Sep 15 12:10:13.282727 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.282681 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerDied","Data":"6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef"} Sep 15 12:10:13.283225 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.282768 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.283225 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.282780 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f574348a-e5e6-4c03-9d6d-d1494f2f3ed9","Type":"ContainerDied","Data":"f138b9980234e06feb3a1ded955b8dc2d22251b36dab4384c494183633f34b0f"} Sep 15 12:10:13.283225 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.282821 2554 scope.go:117] "RemoveContainer" containerID="3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6" Sep 15 12:10:13.291761 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.291638 2554 scope.go:117] "RemoveContainer" containerID="83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205" Sep 15 12:10:13.300450 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.300414 2554 scope.go:117] "RemoveContainer" containerID="6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef" Sep 15 12:10:13.310371 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.310238 2554 scope.go:117] "RemoveContainer" containerID="d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72" Sep 15 12:10:13.311234 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.311216 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:10:13.316122 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.316100 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:10:13.318364 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.318349 2554 scope.go:117] "RemoveContainer" containerID="7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d" Sep 15 12:10:13.325657 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.325631 2554 scope.go:117] "RemoveContainer" containerID="cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25" Sep 15 12:10:13.333397 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.333381 2554 scope.go:117] "RemoveContainer" containerID="e5b9224f30ea85f18ff1d8fd768c9d6923f9f5528531133fc7d29f3850009abc" Sep 15 12:10:13.341618 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.341597 2554 scope.go:117] "RemoveContainer" containerID="3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6" Sep 15 12:10:13.341929 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:13.341901 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6\": container with ID starting with 3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6 not found: ID does not exist" containerID="3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6" Sep 15 12:10:13.342019 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.341938 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6"} err="failed to get container status \"3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6\": rpc error: code = NotFound desc = could not find container \"3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6\": container with ID starting with 3a7e6e9108f2a762fadc56294ac608fb6267ef6c1ef935a4a348b387b3ae31f6 not found: ID does not exist" Sep 15 12:10:13.342019 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.341958 2554 scope.go:117] "RemoveContainer" containerID="83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205" Sep 15 12:10:13.342208 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:13.342183 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205\": container with ID starting with 83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205 not found: ID does not exist" containerID="83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205" Sep 15 12:10:13.342305 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.342214 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205"} err="failed to get container status \"83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205\": rpc error: code = NotFound desc = could not find container \"83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205\": container with ID starting with 83587c51356965dcca465a1bdbc51d241e9ec96868ae0bb0d49bff9fcfa36205 not found: ID does not exist" Sep 15 12:10:13.342305 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.342235 2554 scope.go:117] "RemoveContainer" containerID="6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef" Sep 15 12:10:13.342546 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:13.342524 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef\": container with ID starting with 6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef not found: ID does not exist" containerID="6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef" Sep 15 12:10:13.342620 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.342552 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef"} err="failed to get container status \"6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef\": rpc error: code = NotFound desc = could not find container \"6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef\": container with ID starting with 6ef52c127d3395a7030e45266667c35d67be05a90e5055f8e7153a1ca1f9e5ef not found: ID does not exist" Sep 15 12:10:13.342620 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.342574 2554 scope.go:117] "RemoveContainer" containerID="d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72" Sep 15 12:10:13.342858 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:13.342840 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72\": container with ID starting with d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72 not found: ID does not exist" containerID="d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72" Sep 15 12:10:13.342915 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.342862 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72"} err="failed to get container status \"d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72\": rpc error: code = NotFound desc = could not find container \"d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72\": container with ID starting with d15c19b3b51f0dae8c44f1fd6f3afc7c807d9bfc59c83cdb125ee46fc13a7b72 not found: ID does not exist" Sep 15 12:10:13.342915 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.342876 2554 scope.go:117] "RemoveContainer" containerID="7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d" Sep 15 12:10:13.343238 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:13.343145 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d\": container with ID starting with 7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d not found: ID does not exist" containerID="7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d" Sep 15 12:10:13.343238 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.343170 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d"} err="failed to get container status \"7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d\": rpc error: code = NotFound desc = could not find container \"7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d\": container with ID starting with 7fb29ffdc75446da365843c4a88f981a9c426dd9eafc090d230904649a02de7d not found: ID does not exist" Sep 15 12:10:13.343238 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.343183 2554 scope.go:117] "RemoveContainer" containerID="cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25" Sep 15 12:10:13.343474 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:13.343452 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25\": container with ID starting with cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25 not found: ID does not exist" containerID="cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25" Sep 15 12:10:13.343525 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.343481 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25"} err="failed to get container status \"cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25\": rpc error: code = NotFound desc = could not find container \"cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25\": container with ID starting with cf0a4542eddaab30b16d7908165426e35d704931303ea78108dd75d95a324f25 not found: ID does not exist" Sep 15 12:10:13.343525 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.343498 2554 scope.go:117] "RemoveContainer" containerID="e5b9224f30ea85f18ff1d8fd768c9d6923f9f5528531133fc7d29f3850009abc" Sep 15 12:10:13.343759 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:13.343728 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5b9224f30ea85f18ff1d8fd768c9d6923f9f5528531133fc7d29f3850009abc\": container with ID starting with e5b9224f30ea85f18ff1d8fd768c9d6923f9f5528531133fc7d29f3850009abc not found: ID does not exist" containerID="e5b9224f30ea85f18ff1d8fd768c9d6923f9f5528531133fc7d29f3850009abc" Sep 15 12:10:13.343827 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.343764 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5b9224f30ea85f18ff1d8fd768c9d6923f9f5528531133fc7d29f3850009abc"} err="failed to get container status \"e5b9224f30ea85f18ff1d8fd768c9d6923f9f5528531133fc7d29f3850009abc\": rpc error: code = NotFound desc = could not find container \"e5b9224f30ea85f18ff1d8fd768c9d6923f9f5528531133fc7d29f3850009abc\": container with ID starting with e5b9224f30ea85f18ff1d8fd768c9d6923f9f5528531133fc7d29f3850009abc not found: ID does not exist" Sep 15 12:10:13.352574 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.352551 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:10:13.352939 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.352916 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy" Sep 15 12:10:13.352939 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.352936 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy" Sep 15 12:10:13.353053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.352949 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="prometheus" Sep 15 12:10:13.353053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.352958 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="prometheus" Sep 15 12:10:13.353053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.352971 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="init-config-reloader" Sep 15 12:10:13.353053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.352981 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="init-config-reloader" Sep 15 12:10:13.353053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.352998 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="config-reloader" Sep 15 12:10:13.353053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353007 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="config-reloader" Sep 15 12:10:13.353053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353021 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="thanos-sidecar" Sep 15 12:10:13.353053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353029 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="thanos-sidecar" Sep 15 12:10:13.353053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353038 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy-thanos" Sep 15 12:10:13.353053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353047 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy-thanos" Sep 15 12:10:13.353053 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353055 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy-web" Sep 15 12:10:13.353790 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353064 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy-web" Sep 15 12:10:13.353790 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353126 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy-web" Sep 15 12:10:13.353790 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353135 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy-thanos" Sep 15 12:10:13.353790 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353144 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="prometheus" Sep 15 12:10:13.353790 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353152 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="config-reloader" Sep 15 12:10:13.353790 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353160 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="kube-rbac-proxy" Sep 15 12:10:13.353790 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.353168 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" containerName="thanos-sidecar" Sep 15 12:10:13.356906 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.356885 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.361003 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.360768 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 15 12:10:13.361003 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.360768 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 15 12:10:13.361003 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.360775 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 15 12:10:13.361003 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.360893 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 15 12:10:13.361218 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.361200 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 15 12:10:13.361335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.361318 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 15 12:10:13.361708 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.361692 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 15 12:10:13.362068 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.362048 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 15 12:10:13.362233 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.362178 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 15 12:10:13.362233 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.362215 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8pgs5\"" Sep 15 12:10:13.362367 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.362266 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 15 12:10:13.364272 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.364253 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 15 12:10:13.365035 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.365014 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8j82k6ba28hue\"" Sep 15 12:10:13.365775 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.365498 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 15 12:10:13.370271 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.366218 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 15 12:10:13.371968 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.371941 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 15 12:10:13.378583 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.378561 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 15 12:10:13.390192 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.390171 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.390323 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.390232 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-config\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.390411 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.390322 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7vqz\" (UniqueName: \"kubernetes.io/projected/034402a1-5114-4022-a36b-7c361deb0acb-kube-api-access-z7vqz\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.390411 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.390392 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-web-config\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.390502 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.390465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/034402a1-5114-4022-a36b-7c361deb0acb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.390550 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.390490 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.390657 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.390615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.390872 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.390842 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.390967 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.390886 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.390967 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.390917 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.390967 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.390943 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.391127 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.391013 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.391127 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.391038 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.391127 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.391067 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.391127 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.391090 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.391307 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.391139 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/034402a1-5114-4022-a36b-7c361deb0acb-config-out\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.391307 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.391163 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.391307 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.391188 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.391307 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.391210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.391307 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.391263 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.391901 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.391871 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:10:13.492669 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.492635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.492669 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.492669 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.492918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.492694 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.492918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.492712 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.492918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.492730 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.492918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.492763 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.492918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.492788 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/034402a1-5114-4022-a36b-7c361deb0acb-config-out\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.492918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.492875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.492924 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.492956 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493003 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493049 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493080 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-config\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493114 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7vqz\" (UniqueName: \"kubernetes.io/projected/034402a1-5114-4022-a36b-7c361deb0acb-kube-api-access-z7vqz\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-web-config\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493172 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/034402a1-5114-4022-a36b-7c361deb0acb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493236 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493239 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493760 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493268 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493760 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493294 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493760 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493338 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.493760 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.493549 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.494534 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.494506 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.495119 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.495087 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.495830 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.495446 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.495830 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.495720 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.495972 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.495901 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.496707 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.496247 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/034402a1-5114-4022-a36b-7c361deb0acb-config-out\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.496707 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.496269 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.496707 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.496342 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.496707 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.496502 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.496707 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.496633 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-config\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.497030 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.496795 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/034402a1-5114-4022-a36b-7c361deb0acb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.497693 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.497673 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-web-config\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.497830 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.497786 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/034402a1-5114-4022-a36b-7c361deb0acb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.498122 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.498102 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.498334 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.498317 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.498740 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.498725 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.498913 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.498898 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/034402a1-5114-4022-a36b-7c361deb0acb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.507924 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.507901 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7vqz\" (UniqueName: \"kubernetes.io/projected/034402a1-5114-4022-a36b-7c361deb0acb-kube-api-access-z7vqz\") pod \"prometheus-k8s-0\" (UID: \"034402a1-5114-4022-a36b-7c361deb0acb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.673390 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.673302 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:13.736492 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.736456 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f574348a-e5e6-4c03-9d6d-d1494f2f3ed9" path="/var/lib/kubelet/pods/f574348a-e5e6-4c03-9d6d-d1494f2f3ed9/volumes" Sep 15 12:10:13.961025 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:13.960997 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:10:14.144574 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:10:14.144526 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034402a1_5114_4022_a36b_7c361deb0acb.slice/crio-09bcbf5f0bc5ed73c10c375eb0a18ea67e2521ae94a5f4c60ef3041f6c554b4e WatchSource:0}: Error finding container 09bcbf5f0bc5ed73c10c375eb0a18ea67e2521ae94a5f4c60ef3041f6c554b4e: Status 404 returned error can't find the container with id 09bcbf5f0bc5ed73c10c375eb0a18ea67e2521ae94a5f4c60ef3041f6c554b4e Sep 15 12:10:14.288590 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:14.288561 2554 generic.go:356] "Generic (PLEG): container finished" podID="034402a1-5114-4022-a36b-7c361deb0acb" containerID="e94532df2322a008d037c5770453756f65ba9967e617d7cb9e32145e9fec4e4f" exitCode=0 Sep 15 12:10:14.288915 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:14.288644 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"034402a1-5114-4022-a36b-7c361deb0acb","Type":"ContainerDied","Data":"e94532df2322a008d037c5770453756f65ba9967e617d7cb9e32145e9fec4e4f"} Sep 15 12:10:14.288915 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:14.288719 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"034402a1-5114-4022-a36b-7c361deb0acb","Type":"ContainerStarted","Data":"09bcbf5f0bc5ed73c10c375eb0a18ea67e2521ae94a5f4c60ef3041f6c554b4e"} Sep 15 12:10:14.291122 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:14.291097 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" event={"ID":"2d737cca-780b-425e-86b5-013dd051ac52","Type":"ContainerStarted","Data":"786e7e95479afd53e533cdeae4400abb76d3b98dbd7907165123833f6a0515d1"} Sep 15 12:10:15.297201 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.297156 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" event={"ID":"2d737cca-780b-425e-86b5-013dd051ac52","Type":"ContainerStarted","Data":"b401e9fd63d314dbd15275b4a04905c78750919b0aef306445742290b140e2f5"} Sep 15 12:10:15.297646 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.297255 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" event={"ID":"2d737cca-780b-425e-86b5-013dd051ac52","Type":"ContainerStarted","Data":"8fc9f0117572c6e93c697b2f25982bc9b4b979263d684094513d50ee601ce7a9"} Sep 15 12:10:15.300489 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.300462 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"034402a1-5114-4022-a36b-7c361deb0acb","Type":"ContainerStarted","Data":"0b299873cf86d7dec65ce5a8cccd2bbfbf73542af680da071f884104ed061e38"} Sep 15 12:10:15.300588 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.300531 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"034402a1-5114-4022-a36b-7c361deb0acb","Type":"ContainerStarted","Data":"0e10a5e15ba014648afaabb368f548fcbbe2ecfb5d584a6d4fd017da3eff0017"} Sep 15 12:10:15.300588 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.300570 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"034402a1-5114-4022-a36b-7c361deb0acb","Type":"ContainerStarted","Data":"668a68f75f272ba71c7853c619fdfa7863e9b2fecb207b3cad7ee37b2b467c82"} Sep 15 12:10:15.300669 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.300613 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"034402a1-5114-4022-a36b-7c361deb0acb","Type":"ContainerStarted","Data":"8ac941513107fbeaff61561cf8ce19c42ac20fa9878c1968fccf7b4d56ee76bd"} Sep 15 12:10:15.300669 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.300642 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"034402a1-5114-4022-a36b-7c361deb0acb","Type":"ContainerStarted","Data":"69f1d20d4da4258ad831cc5161dfe4199b57669b72085b68ae840bd5911097a7"} Sep 15 12:10:15.300669 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.300665 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"034402a1-5114-4022-a36b-7c361deb0acb","Type":"ContainerStarted","Data":"c6a6393cc583bf32665a05d3c5ee38e45817abc7a2c8c6b5644f47656585be38"} Sep 15 12:10:15.322881 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.322836 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-95d75fbd9-zj8gf" podStartSLOduration=2.279478253 podStartE2EDuration="4.322818138s" totalImagesPullingTime="2.043339885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:10:15.321028761 +0000 UTC m=+110.205223480" watchObservedRunningTime="2026-09-15 12:10:15.322818138 +0000 UTC m=+110.207012847" Sep 15 12:10:15.352713 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.352672 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.332168548 podStartE2EDuration="2.352660328s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.49178ms" isStatefulPod=false podCreationTimestamp="2026-09-15 12:10:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:10:15.351272056 +0000 UTC m=+110.235466802" watchObservedRunningTime="2026-09-15 12:10:15.352660328 +0000 UTC m=+110.236855037" Sep 15 12:10:15.419160 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.419132 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b68c5db67-gfwch"] Sep 15 12:10:15.421318 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.421298 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.435428 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.435406 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b68c5db67-gfwch"] Sep 15 12:10:15.479767 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.479724 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:10:15.513135 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.513102 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-oauth-serving-cert\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.513275 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.513201 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-trusted-ca-bundle\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.513336 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.513323 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-oauth-config\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.513384 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.513362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-config\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.513765 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.513396 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-service-ca\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.513765 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.513472 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-serving-cert\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.513765 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.513495 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf2xp\" (UniqueName: \"kubernetes.io/projected/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-kube-api-access-mf2xp\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.581165 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.581071 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:10:15.614280 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.614249 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-oauth-config\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.614280 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.614283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-config\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.614463 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.614302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-service-ca\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.614463 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.614378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-serving-cert\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.614463 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.614418 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf2xp\" (UniqueName: \"kubernetes.io/projected/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-kube-api-access-mf2xp\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.614561 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.614489 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-oauth-serving-cert\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.614561 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.614517 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-trusted-ca-bundle\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.615096 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.615069 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-service-ca\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.615219 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.615115 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-config\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.615277 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.615219 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-oauth-serving-cert\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.615373 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.615355 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-trusted-ca-bundle\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.616979 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.616955 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-oauth-config\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.617060 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.617043 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-serving-cert\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.623403 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.623381 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf2xp\" (UniqueName: \"kubernetes.io/projected/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-kube-api-access-mf2xp\") pod \"console-6b68c5db67-gfwch\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:15.681435 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.681397 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:10:15.730918 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:15.730880 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:16.007505 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:16.007471 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b68c5db67-gfwch"] Sep 15 12:10:16.011053 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:10:16.011026 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ea0d2b_9c4d_4d53_a9ca_9c3d7eab400c.slice/crio-19853ab9f31d25f5bdb26d880dcdf1585c688a05ceaca67584535aba8cb362f4 WatchSource:0}: Error finding container 19853ab9f31d25f5bdb26d880dcdf1585c688a05ceaca67584535aba8cb362f4: Status 404 returned error can't find the container with id 19853ab9f31d25f5bdb26d880dcdf1585c688a05ceaca67584535aba8cb362f4 Sep 15 12:10:16.209791 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:16.209726 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:10:16.264356 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:16.264271 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:10:16.306901 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:16.306860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b68c5db67-gfwch" event={"ID":"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c","Type":"ContainerStarted","Data":"46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d"} Sep 15 12:10:16.307339 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:16.306924 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b68c5db67-gfwch" event={"ID":"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c","Type":"ContainerStarted","Data":"19853ab9f31d25f5bdb26d880dcdf1585c688a05ceaca67584535aba8cb362f4"} Sep 15 12:10:16.324499 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:16.324452 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b68c5db67-gfwch" podStartSLOduration=1.324434068 podStartE2EDuration="1.324434068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:10:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:10:16.324314004 +0000 UTC m=+111.208508712" watchObservedRunningTime="2026-09-15 12:10:16.324434068 +0000 UTC m=+111.208628778" Sep 15 12:10:18.673956 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:18.673905 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:10:25.732046 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:25.732011 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:25.732424 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:25.732057 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:25.737005 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:25.736981 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:26.353564 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:26.353535 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:10:26.398241 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:26.398210 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d7c7789b-f78nx"] Sep 15 12:10:26.528231 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:26.528199 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:10:26.657644 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:26.657563 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:10:26.720710 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:26.720679 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:10:51.418919 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.418881 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77d7c7789b-f78nx" podUID="8d1dcc9b-ce2f-4be1-86de-440eb45e682f" containerName="console" containerID="cri-o://78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041" gracePeriod=15 Sep 15 12:10:51.653729 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.653702 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:10:51.725558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.725529 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-oauth-config\") pod \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " Sep 15 12:10:51.725736 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.725569 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtjwl\" (UniqueName: \"kubernetes.io/projected/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-kube-api-access-xtjwl\") pod \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " Sep 15 12:10:51.725736 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.725599 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-trusted-ca-bundle\") pod \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " Sep 15 12:10:51.725736 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.725633 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-oauth-serving-cert\") pod \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " Sep 15 12:10:51.725736 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.725659 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-service-ca\") pod \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " Sep 15 12:10:51.725736 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.725696 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-serving-cert\") pod \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " Sep 15 12:10:51.725736 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.725740 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-config\") pod \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\" (UID: \"8d1dcc9b-ce2f-4be1-86de-440eb45e682f\") " Sep 15 12:10:51.726082 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.726040 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8d1dcc9b-ce2f-4be1-86de-440eb45e682f" (UID: "8d1dcc9b-ce2f-4be1-86de-440eb45e682f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:51.726139 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.726090 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-service-ca" (OuterVolumeSpecName: "service-ca") pod "8d1dcc9b-ce2f-4be1-86de-440eb45e682f" (UID: "8d1dcc9b-ce2f-4be1-86de-440eb45e682f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:51.726248 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.726227 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-config" (OuterVolumeSpecName: "console-config") pod "8d1dcc9b-ce2f-4be1-86de-440eb45e682f" (UID: "8d1dcc9b-ce2f-4be1-86de-440eb45e682f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:51.726348 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.726321 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8d1dcc9b-ce2f-4be1-86de-440eb45e682f" (UID: "8d1dcc9b-ce2f-4be1-86de-440eb45e682f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:10:51.727923 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.727895 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8d1dcc9b-ce2f-4be1-86de-440eb45e682f" (UID: "8d1dcc9b-ce2f-4be1-86de-440eb45e682f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:51.728014 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.727964 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8d1dcc9b-ce2f-4be1-86de-440eb45e682f" (UID: "8d1dcc9b-ce2f-4be1-86de-440eb45e682f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:10:51.728249 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.728229 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-kube-api-access-xtjwl" (OuterVolumeSpecName: "kube-api-access-xtjwl") pod "8d1dcc9b-ce2f-4be1-86de-440eb45e682f" (UID: "8d1dcc9b-ce2f-4be1-86de-440eb45e682f"). InnerVolumeSpecName "kube-api-access-xtjwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:10:51.826693 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.826660 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-service-ca\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:51.826693 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.826687 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:51.826693 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.826696 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:51.826942 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.826707 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-console-oauth-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:51.826942 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.826716 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtjwl\" (UniqueName: \"kubernetes.io/projected/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-kube-api-access-xtjwl\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:51.826942 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.826726 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-trusted-ca-bundle\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:51.826942 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:51.826739 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1dcc9b-ce2f-4be1-86de-440eb45e682f-oauth-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:10:52.449648 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:52.449607 2554 generic.go:356] "Generic (PLEG): container finished" podID="8d1dcc9b-ce2f-4be1-86de-440eb45e682f" containerID="78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041" exitCode=0 Sep 15 12:10:52.450058 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:52.449672 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d7c7789b-f78nx" Sep 15 12:10:52.450058 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:52.449691 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d7c7789b-f78nx" event={"ID":"8d1dcc9b-ce2f-4be1-86de-440eb45e682f","Type":"ContainerDied","Data":"78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041"} Sep 15 12:10:52.450058 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:52.449795 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d7c7789b-f78nx" event={"ID":"8d1dcc9b-ce2f-4be1-86de-440eb45e682f","Type":"ContainerDied","Data":"55d6fd897d4be19ecb736e9d0348d4d4387a85ff09b02de9f985f9c25a890184"} Sep 15 12:10:52.450058 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:52.449817 2554 scope.go:117] "RemoveContainer" containerID="78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041" Sep 15 12:10:52.457806 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:52.457787 2554 scope.go:117] "RemoveContainer" containerID="78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041" Sep 15 12:10:52.458088 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:10:52.458068 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041\": container with ID starting with 78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041 not found: ID does not exist" containerID="78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041" Sep 15 12:10:52.458154 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:52.458097 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041"} err="failed to get container status \"78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041\": rpc error: code = NotFound desc = could not find container \"78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041\": container with ID starting with 78200aaf834967463cfa8ac937900922954ee3112e9a3d81dd7a7b5dc723f041 not found: ID does not exist" Sep 15 12:10:52.466190 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:52.466168 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d7c7789b-f78nx"] Sep 15 12:10:52.469591 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:52.469572 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77d7c7789b-f78nx"] Sep 15 12:10:52.486854 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:52.486828 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:10:53.730127 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:10:53.730088 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d1dcc9b-ce2f-4be1-86de-440eb45e682f" path="/var/lib/kubelet/pods/8d1dcc9b-ce2f-4be1-86de-440eb45e682f/volumes" Sep 15 12:11:13.673841 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:13.673790 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:11:13.689158 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:13.689131 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:11:14.549436 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:14.549402 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:11:21.687335 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:21.687223 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:21.746346 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:21.746297 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:25.256283 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.256245 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f6b54d5fd-2r7jw"] Sep 15 12:11:25.256734 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.256551 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d1dcc9b-ce2f-4be1-86de-440eb45e682f" containerName="console" Sep 15 12:11:25.256734 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.256563 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d1dcc9b-ce2f-4be1-86de-440eb45e682f" containerName="console" Sep 15 12:11:25.256734 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.256618 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d1dcc9b-ce2f-4be1-86de-440eb45e682f" containerName="console" Sep 15 12:11:25.259700 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.259682 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.270919 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.270890 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f6b54d5fd-2r7jw"] Sep 15 12:11:25.315488 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.315457 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:25.375360 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.375328 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:25.415651 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.415613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-service-ca\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.415651 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.415653 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-oauth-serving-cert\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.415837 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.415675 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvngh\" (UniqueName: \"kubernetes.io/projected/ed9f479c-03a0-4b92-b5e3-39410356d96e-kube-api-access-bvngh\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.415837 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.415801 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed9f479c-03a0-4b92-b5e3-39410356d96e-console-serving-cert\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.415837 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.415829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-console-config\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.415952 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.415847 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-trusted-ca-bundle\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.415952 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.415924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed9f479c-03a0-4b92-b5e3-39410356d96e-console-oauth-config\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.461706 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.461672 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:25.517006 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.516983 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed9f479c-03a0-4b92-b5e3-39410356d96e-console-serving-cert\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.517077 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.517015 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-console-config\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.517077 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.517030 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-trusted-ca-bundle\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.517077 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.517061 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed9f479c-03a0-4b92-b5e3-39410356d96e-console-oauth-config\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.517171 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.517118 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-service-ca\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.517171 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.517144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-oauth-serving-cert\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.517268 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.517175 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvngh\" (UniqueName: \"kubernetes.io/projected/ed9f479c-03a0-4b92-b5e3-39410356d96e-kube-api-access-bvngh\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.517841 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.517819 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-oauth-serving-cert\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.517841 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.517831 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-console-config\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.517973 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.517885 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-trusted-ca-bundle\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.517973 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.517951 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed9f479c-03a0-4b92-b5e3-39410356d96e-service-ca\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.519498 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.519473 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed9f479c-03a0-4b92-b5e3-39410356d96e-console-oauth-config\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.519572 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.519536 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed9f479c-03a0-4b92-b5e3-39410356d96e-console-serving-cert\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.521623 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.521601 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:25.524668 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.524644 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvngh\" (UniqueName: \"kubernetes.io/projected/ed9f479c-03a0-4b92-b5e3-39410356d96e-kube-api-access-bvngh\") pod \"console-6f6b54d5fd-2r7jw\" (UID: \"ed9f479c-03a0-4b92-b5e3-39410356d96e\") " pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.568827 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.568791 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:25.680032 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.679999 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:25.748634 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.748600 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:25.849371 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:25.849290 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f6b54d5fd-2r7jw"] Sep 15 12:11:25.852586 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:11:25.852555 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded9f479c_03a0_4b92_b5e3_39410356d96e.slice/crio-fa20abefd374b65759f15c9e30216ea3efd3b1e75df4bf9a93d116f249ef335d WatchSource:0}: Error finding container fa20abefd374b65759f15c9e30216ea3efd3b1e75df4bf9a93d116f249ef335d: Status 404 returned error can't find the container with id fa20abefd374b65759f15c9e30216ea3efd3b1e75df4bf9a93d116f249ef335d Sep 15 12:11:26.105943 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:26.105849 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:26.577670 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:26.577637 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6b54d5fd-2r7jw" event={"ID":"ed9f479c-03a0-4b92-b5e3-39410356d96e","Type":"ContainerStarted","Data":"9b5c847bf26688b3dfee34e4f0d1320f7ad89f885545b190a84f23a0675a2299"} Sep 15 12:11:26.578070 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:26.577685 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6b54d5fd-2r7jw" event={"ID":"ed9f479c-03a0-4b92-b5e3-39410356d96e","Type":"ContainerStarted","Data":"fa20abefd374b65759f15c9e30216ea3efd3b1e75df4bf9a93d116f249ef335d"} Sep 15 12:11:26.594813 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:26.594762 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f6b54d5fd-2r7jw" podStartSLOduration=1.5947295879999999 podStartE2EDuration="1.594729588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:11:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:11:26.593864356 +0000 UTC m=+181.478059088" watchObservedRunningTime="2026-09-15 12:11:26.594729588 +0000 UTC m=+181.478924296" Sep 15 12:11:33.744182 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:33.744145 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:33.799567 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:33.799538 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:35.569473 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:35.569432 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:35.569844 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:35.569506 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:35.574311 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:35.574286 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:35.614837 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:35.614808 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f6b54d5fd-2r7jw" Sep 15 12:11:35.667200 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:35.667168 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b68c5db67-gfwch"] Sep 15 12:11:35.774057 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:35.774024 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:35.875161 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:35.875076 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:35.941496 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:35.941469 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:48.524329 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:48.524293 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:49.709115 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:49.709079 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:11:50.371024 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:11:50.370991 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:12:00.686200 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:00.686141 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b68c5db67-gfwch" podUID="25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" containerName="console" containerID="cri-o://46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d" gracePeriod=15 Sep 15 12:12:00.920545 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:00.920520 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:12:01.005924 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.005888 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-config\") pod \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " Sep 15 12:12:01.006045 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.005946 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf2xp\" (UniqueName: \"kubernetes.io/projected/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-kube-api-access-mf2xp\") pod \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " Sep 15 12:12:01.006045 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.005988 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-serving-cert\") pod \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " Sep 15 12:12:01.006119 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.006055 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-oauth-serving-cert\") pod \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " Sep 15 12:12:01.006119 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.006090 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-service-ca\") pod \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " Sep 15 12:12:01.006208 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.006136 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-trusted-ca-bundle\") pod \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " Sep 15 12:12:01.006208 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.006160 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-oauth-config\") pod \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\" (UID: \"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c\") " Sep 15 12:12:01.006320 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.006299 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-config" (OuterVolumeSpecName: "console-config") pod "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" (UID: "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:12:01.006419 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.006400 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:12:01.006501 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.006467 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" (UID: "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:12:01.006574 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.006519 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" (UID: "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:12:01.006620 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.006562 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-service-ca" (OuterVolumeSpecName: "service-ca") pod "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" (UID: "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:12:01.008118 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.008089 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" (UID: "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:12:01.008207 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.008097 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-kube-api-access-mf2xp" (OuterVolumeSpecName: "kube-api-access-mf2xp") pod "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" (UID: "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c"). InnerVolumeSpecName "kube-api-access-mf2xp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:12:01.008207 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.008102 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" (UID: "25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:12:01.107610 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.107574 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-oauth-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:12:01.107610 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.107606 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-service-ca\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:12:01.107610 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.107615 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-trusted-ca-bundle\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:12:01.107811 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.107624 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-oauth-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:12:01.107811 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.107633 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf2xp\" (UniqueName: \"kubernetes.io/projected/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-kube-api-access-mf2xp\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:12:01.107811 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.107641 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c-console-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 15 12:12:01.703818 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.703782 2554 generic.go:356] "Generic (PLEG): container finished" podID="25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" containerID="46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d" exitCode=0 Sep 15 12:12:01.704243 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.703824 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b68c5db67-gfwch" Sep 15 12:12:01.704243 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.703837 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b68c5db67-gfwch" event={"ID":"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c","Type":"ContainerDied","Data":"46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d"} Sep 15 12:12:01.704243 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.703893 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b68c5db67-gfwch" event={"ID":"25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c","Type":"ContainerDied","Data":"19853ab9f31d25f5bdb26d880dcdf1585c688a05ceaca67584535aba8cb362f4"} Sep 15 12:12:01.704243 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.703921 2554 scope.go:117] "RemoveContainer" containerID="46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d" Sep 15 12:12:01.712169 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.712154 2554 scope.go:117] "RemoveContainer" containerID="46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d" Sep 15 12:12:01.712465 ip-10-0-133-129 kubenswrapper[2554]: E0915 12:12:01.712445 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d\": container with ID starting with 46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d not found: ID does not exist" containerID="46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d" Sep 15 12:12:01.712511 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.712474 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d"} err="failed to get container status \"46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d\": rpc error: code = NotFound desc = could not find container \"46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d\": container with ID starting with 46c53f91e419a8b56ef27d3d6128dd1041f9c81c2c1167ce6bb5f719bb6caa3d not found: ID does not exist" Sep 15 12:12:01.723700 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.723679 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b68c5db67-gfwch"] Sep 15 12:12:01.734466 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:01.730427 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b68c5db67-gfwch"] Sep 15 12:12:03.728939 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:03.728907 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" path="/var/lib/kubelet/pods/25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c/volumes" Sep 15 12:12:30.813783 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:30.813732 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:12:30.916931 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:30.916902 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:12:40.447283 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:40.447250 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:12:40.539920 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:40.539887 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" limit=1024 Sep 15 12:12:43.253541 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:43.253512 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xqtr5_c5224c06-9441-4fa1-9e01-bdcad9e209ca/global-pull-secret-syncer/0.log" Sep 15 12:12:43.302479 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:43.302452 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-45kq5_f022801b-0620-499b-9cec-35f188cd2b18/konnectivity-agent/0.log" Sep 15 12:12:43.379109 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:43.379064 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-129.ec2.internal_21d8db619fc55d5e2c141cfa89e47713/haproxy/0.log" Sep 15 12:12:47.375161 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.375115 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_838872b0-d9e1-4d78-b43c-fc3b00f8ce31/alertmanager/0.log" Sep 15 12:12:47.399164 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.399110 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_838872b0-d9e1-4d78-b43c-fc3b00f8ce31/config-reloader/0.log" Sep 15 12:12:47.423954 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.423931 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_838872b0-d9e1-4d78-b43c-fc3b00f8ce31/kube-rbac-proxy-web/0.log" Sep 15 12:12:47.453681 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.453661 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_838872b0-d9e1-4d78-b43c-fc3b00f8ce31/kube-rbac-proxy/0.log" Sep 15 12:12:47.477852 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.477831 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_838872b0-d9e1-4d78-b43c-fc3b00f8ce31/kube-rbac-proxy-metric/0.log" Sep 15 12:12:47.501699 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.501681 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_838872b0-d9e1-4d78-b43c-fc3b00f8ce31/prom-label-proxy/0.log" Sep 15 12:12:47.524914 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.524888 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_838872b0-d9e1-4d78-b43c-fc3b00f8ce31/init-config-reloader/0.log" Sep 15 12:12:47.887198 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.887165 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9sq2_6ac69496-d958-486c-8f81-9a6235b994ce/node-exporter/0.log" Sep 15 12:12:47.907776 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.907689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9sq2_6ac69496-d958-486c-8f81-9a6235b994ce/kube-rbac-proxy/0.log" Sep 15 12:12:47.927605 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.927584 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9sq2_6ac69496-d958-486c-8f81-9a6235b994ce/init-textfile/0.log" Sep 15 12:12:47.954288 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.954264 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-zjbxl_b5ac26a6-517d-4cfc-bc0d-c98849214cdf/kube-rbac-proxy-main/0.log" Sep 15 12:12:47.982975 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:47.982937 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-zjbxl_b5ac26a6-517d-4cfc-bc0d-c98849214cdf/kube-rbac-proxy-self/0.log" Sep 15 12:12:48.006575 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.006555 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-zjbxl_b5ac26a6-517d-4cfc-bc0d-c98849214cdf/openshift-state-metrics/0.log" Sep 15 12:12:48.042130 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.042108 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_034402a1-5114-4022-a36b-7c361deb0acb/prometheus/0.log" Sep 15 12:12:48.067830 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.067804 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_034402a1-5114-4022-a36b-7c361deb0acb/config-reloader/0.log" Sep 15 12:12:48.087884 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.087832 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_034402a1-5114-4022-a36b-7c361deb0acb/thanos-sidecar/0.log" Sep 15 12:12:48.109011 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.108991 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_034402a1-5114-4022-a36b-7c361deb0acb/kube-rbac-proxy-web/0.log" Sep 15 12:12:48.130578 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.130562 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_034402a1-5114-4022-a36b-7c361deb0acb/kube-rbac-proxy/0.log" Sep 15 12:12:48.154363 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.154347 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_034402a1-5114-4022-a36b-7c361deb0acb/kube-rbac-proxy-thanos/0.log" Sep 15 12:12:48.181683 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.181660 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_034402a1-5114-4022-a36b-7c361deb0acb/init-config-reloader/0.log" Sep 15 12:12:48.213108 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.213083 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-vjk7x_ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2/prometheus-operator/0.log" Sep 15 12:12:48.237064 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.237044 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-vjk7x_ea7d3f6a-4084-4c40-8e8b-3a1eb38726c2/kube-rbac-proxy/0.log" Sep 15 12:12:48.294524 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.294498 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-95d75fbd9-zj8gf_2d737cca-780b-425e-86b5-013dd051ac52/telemeter-client/0.log" Sep 15 12:12:48.314889 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.314865 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-95d75fbd9-zj8gf_2d737cca-780b-425e-86b5-013dd051ac52/reload/0.log" Sep 15 12:12:48.335560 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:48.335541 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-95d75fbd9-zj8gf_2d737cca-780b-425e-86b5-013dd051ac52/kube-rbac-proxy/0.log" Sep 15 12:12:50.514690 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.514663 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f6b54d5fd-2r7jw_ed9f479c-03a0-4b92-b5e3-39410356d96e/console/0.log" Sep 15 12:12:50.734909 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.734875 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p"] Sep 15 12:12:50.735200 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.735187 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" containerName="console" Sep 15 12:12:50.735244 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.735202 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" containerName="console" Sep 15 12:12:50.735278 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.735268 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="25ea0d2b-9c4d-4d53-a9ca-9c3d7eab400c" containerName="console" Sep 15 12:12:50.737993 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.737978 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.740512 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.740488 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7txw7\"/\"kube-root-ca.crt\"" Sep 15 12:12:50.746417 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.746387 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7txw7\"/\"default-dockercfg-wjgn4\"" Sep 15 12:12:50.746417 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.746411 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7txw7\"/\"openshift-service-ca.crt\"" Sep 15 12:12:50.754356 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.754328 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p"] Sep 15 12:12:50.802904 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.802827 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-podres\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.802904 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.802861 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcxpk\" (UniqueName: \"kubernetes.io/projected/8700941a-f861-46f2-a52d-7629b92fee08-kube-api-access-dcxpk\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.802904 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.802879 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-lib-modules\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.802904 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.802903 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-proc\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.803130 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.802965 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-sys\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.903578 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.903544 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-podres\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.903578 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.903576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcxpk\" (UniqueName: \"kubernetes.io/projected/8700941a-f861-46f2-a52d-7629b92fee08-kube-api-access-dcxpk\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.903812 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.903597 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-lib-modules\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.903812 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.903616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-proc\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.903812 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.903681 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-sys\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.903812 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.903716 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-podres\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.903812 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.903771 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-lib-modules\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.903812 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.903780 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-proc\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.904001 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.903813 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8700941a-f861-46f2-a52d-7629b92fee08-sys\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:50.911530 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:50.911506 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcxpk\" (UniqueName: \"kubernetes.io/projected/8700941a-f861-46f2-a52d-7629b92fee08-kube-api-access-dcxpk\") pod \"perf-node-gather-daemonset-j8w8p\" (UID: \"8700941a-f861-46f2-a52d-7629b92fee08\") " pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:51.053450 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:51.053378 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:51.322635 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:51.322549 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p"] Sep 15 12:12:51.325561 ip-10-0-133-129 kubenswrapper[2554]: W0915 12:12:51.325527 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8700941a_f861_46f2_a52d_7629b92fee08.slice/crio-242ddaa595fe99be414a8553e24c235392ebef44ad4a6f19e2a28c2812db1878 WatchSource:0}: Error finding container 242ddaa595fe99be414a8553e24c235392ebef44ad4a6f19e2a28c2812db1878: Status 404 returned error can't find the container with id 242ddaa595fe99be414a8553e24c235392ebef44ad4a6f19e2a28c2812db1878 Sep 15 12:12:51.879642 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:51.879611 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" event={"ID":"8700941a-f861-46f2-a52d-7629b92fee08","Type":"ContainerStarted","Data":"b9a4befea224298977e3f5060ad7a68f3448c495dda01d6396beb05e03e2445a"} Sep 15 12:12:51.880137 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:51.879660 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" event={"ID":"8700941a-f861-46f2-a52d-7629b92fee08","Type":"ContainerStarted","Data":"242ddaa595fe99be414a8553e24c235392ebef44ad4a6f19e2a28c2812db1878"} Sep 15 12:12:51.880137 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:51.879768 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:51.895353 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:51.895310 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" podStartSLOduration=1.895295849 podStartE2EDuration="1.895295849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:12:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:12:51.89392268 +0000 UTC m=+266.778117394" watchObservedRunningTime="2026-09-15 12:12:51.895295849 +0000 UTC m=+266.779490557" Sep 15 12:12:51.916670 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:51.916627 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pbjdd_f3aeddc0-d979-438c-8774-09a0c5a43dbe/dns/0.log" Sep 15 12:12:51.938089 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:51.938069 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pbjdd_f3aeddc0-d979-438c-8774-09a0c5a43dbe/kube-rbac-proxy/0.log" Sep 15 12:12:51.990874 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:51.990847 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lkncf_d72ef612-fab9-45ed-bac5-1826950a3556/dns-node-resolver/0.log" Sep 15 12:12:52.419935 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:52.419907 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2t9g8_4f524964-795d-40de-b171-5ac191703ccf/node-ca/0.log" Sep 15 12:12:53.570415 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:53.570363 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ks7zh_04ec1fbd-a1a1-40fb-a1fe-db24fb2d4179/serve-healthcheck-canary/0.log" Sep 15 12:12:54.082520 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:54.082493 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8pnz4_6d20c77d-ef6d-41a8-8dee-f353401bdb55/kube-rbac-proxy/0.log" Sep 15 12:12:54.113849 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:54.113818 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8pnz4_6d20c77d-ef6d-41a8-8dee-f353401bdb55/exporter/0.log" Sep 15 12:12:54.144635 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:54.144607 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8pnz4_6d20c77d-ef6d-41a8-8dee-f353401bdb55/extractor/0.log" Sep 15 12:12:57.894383 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:57.894353 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7txw7/perf-node-gather-daemonset-j8w8p" Sep 15 12:12:59.811898 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:59.811874 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s57mq_346a39f9-47a5-48bc-84c9-3365140ca411/kube-multus-additional-cni-plugins/0.log" Sep 15 12:12:59.834316 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:59.834293 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s57mq_346a39f9-47a5-48bc-84c9-3365140ca411/egress-router-binary-copy/0.log" Sep 15 12:12:59.864401 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:59.864378 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s57mq_346a39f9-47a5-48bc-84c9-3365140ca411/cni-plugins/0.log" Sep 15 12:12:59.893568 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:59.893547 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s57mq_346a39f9-47a5-48bc-84c9-3365140ca411/bond-cni-plugin/0.log" Sep 15 12:12:59.922162 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:59.922144 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s57mq_346a39f9-47a5-48bc-84c9-3365140ca411/routeoverride-cni/0.log" Sep 15 12:12:59.949023 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:59.949005 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s57mq_346a39f9-47a5-48bc-84c9-3365140ca411/whereabouts-cni-bincopy/0.log" Sep 15 12:12:59.973767 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:12:59.973712 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s57mq_346a39f9-47a5-48bc-84c9-3365140ca411/whereabouts-cni/0.log" Sep 15 12:13:00.378227 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:00.378197 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vvzfs_10c47df8-15f0-449c-98c9-7c930a5c1733/kube-multus/0.log" Sep 15 12:13:00.454176 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:00.454151 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fqj7b_b7b35aca-f916-427c-a664-c01548bdef0f/network-metrics-daemon/0.log" Sep 15 12:13:00.478049 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:00.478031 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fqj7b_b7b35aca-f916-427c-a664-c01548bdef0f/kube-rbac-proxy/0.log" Sep 15 12:13:01.486387 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:01.486314 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d8vz_d78c5771-0326-4644-9faa-95f66a5f6863/ovn-controller/0.log" Sep 15 12:13:01.509081 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:01.509057 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d8vz_d78c5771-0326-4644-9faa-95f66a5f6863/ovn-acl-logging/0.log" Sep 15 12:13:01.534474 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:01.534455 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d8vz_d78c5771-0326-4644-9faa-95f66a5f6863/kube-rbac-proxy-node/0.log" Sep 15 12:13:01.559422 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:01.559402 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d8vz_d78c5771-0326-4644-9faa-95f66a5f6863/kube-rbac-proxy-ovn-metrics/0.log" Sep 15 12:13:01.588544 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:01.588527 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d8vz_d78c5771-0326-4644-9faa-95f66a5f6863/northd/0.log" Sep 15 12:13:01.616836 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:01.616818 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d8vz_d78c5771-0326-4644-9faa-95f66a5f6863/nbdb/0.log" Sep 15 12:13:01.639402 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:01.639386 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d8vz_d78c5771-0326-4644-9faa-95f66a5f6863/sbdb/0.log" Sep 15 12:13:01.676182 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:01.676159 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d8vz_d78c5771-0326-4644-9faa-95f66a5f6863/ovnkube-controller/0.log" Sep 15 12:13:02.889558 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:02.889533 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-n2jfb_4faba139-910e-4c25-83b8-41797f237bf8/network-check-target-container/0.log" Sep 15 12:13:03.773158 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:03.773129 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-78d5v_5f6e066f-ee71-4484-88e9-2b6fce04d6c4/iptables-alerter/0.log" Sep 15 12:13:04.443571 ip-10-0-133-129 kubenswrapper[2554]: I0915 12:13:04.443541 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-mr4g2_895e6556-3cac-43f1-9e9f-580024280cd9/tuned/0.log"