Sep 09 23:22:24.471428 ip-10-0-136-79 systemd[1]: Starting Kubernetes Kubelet... Sep 09 23:22:24.827605 ip-10-0-136-79 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:22:24.827605 ip-10-0-136-79 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 23:22:24.827605 ip-10-0-136-79 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:22:24.827605 ip-10-0-136-79 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 23:22:24.827605 ip-10-0-136-79 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:22:24.828311 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.827618 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 23:22:24.834723 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834696 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:22:24.834831 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834823 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:22:24.834831 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834830 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834834 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834837 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834842 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834846 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834849 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834851 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834854 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834857 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834859 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834862 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834865 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834868 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834871 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834873 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834876 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834879 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834882 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834884 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834887 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:22:24.834888 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834890 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834893 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834896 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834899 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834902 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834905 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834908 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834910 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834913 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834915 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834918 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834922 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834924 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834927 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834930 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834932 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834935 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834938 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834940 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834943 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:22:24.835389 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834945 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834948 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834950 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834953 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834956 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834958 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834961 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834964 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834968 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834971 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834973 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834976 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834978 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834981 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834984 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834987 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834990 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834993 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.834996 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835003 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:22:24.835870 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835007 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835010 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835013 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835017 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835021 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835025 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835028 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835031 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835034 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835037 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835040 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835043 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835045 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835049 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835051 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835054 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835057 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835060 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835063 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835066 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:22:24.836373 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835068 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835073 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835075 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835078 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835082 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835085 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835088 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835091 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835094 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835097 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835101 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835104 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835107 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835110 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835113 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835115 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835118 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835825 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835832 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:22:24.836866 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835836 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835839 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835842 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835845 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835848 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835850 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835853 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835856 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835858 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835862 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835864 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835867 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835870 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835873 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835876 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835879 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835882 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835885 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835887 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:22:24.837342 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835890 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835895 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835899 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835902 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835904 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835907 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835910 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835913 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835915 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835918 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835920 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835923 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835926 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835929 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835933 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835936 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835938 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835942 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835944 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:22:24.837806 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835947 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835950 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835952 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835955 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835958 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835960 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835963 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835966 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835969 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835971 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835974 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835977 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835979 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835984 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835988 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835991 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835995 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.835998 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836000 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836003 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:22:24.838293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836006 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836009 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836012 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836015 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836018 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836020 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836023 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836026 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836029 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836032 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836035 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836037 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836040 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836042 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836045 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836047 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836050 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836053 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836055 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836060 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:22:24.838777 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836063 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836066 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836069 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836072 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836075 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836078 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836080 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836083 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836086 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836088 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836091 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836093 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836096 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836099 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836101 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836104 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836106 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836109 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836112 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836531 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:22:24.839271 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836537 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836540 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836542 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836545 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836548 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836550 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836553 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836555 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836558 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836561 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836563 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836566 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836569 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836571 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836574 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836577 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836580 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836583 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836586 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836588 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:22:24.839760 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836591 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836593 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836596 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836598 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836601 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836604 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836606 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836609 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836611 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836614 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836617 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836620 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836623 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836626 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836629 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836633 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836635 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836637 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836640 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836642 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:22:24.840289 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836645 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836648 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836650 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836652 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836655 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836658 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836660 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836663 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836666 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836668 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836671 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836673 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836676 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836678 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836681 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836683 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836686 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836688 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836693 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836696 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:22:24.840775 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836699 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836702 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836705 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836708 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836711 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836714 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836717 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836720 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836724 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836727 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836730 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836733 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836736 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836739 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836742 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836745 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836747 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836751 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836754 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:22:24.841280 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836756 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836761 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836765 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836767 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836770 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836772 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836775 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836777 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836780 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836782 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836785 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836788 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836790 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836793 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836795 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836797 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836800 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836802 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.836805 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836877 2563 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 23:22:24.841770 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836910 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836918 2563 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836923 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836932 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836935 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836939 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836943 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836946 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836949 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836952 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836955 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836958 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836962 2563 flags.go:64] FLAG: --cgroup-root="" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836966 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836969 2563 flags.go:64] FLAG: --client-ca-file="" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836973 2563 flags.go:64] FLAG: --cloud-provider="external" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836976 2563 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836979 2563 flags.go:64] FLAG: --cluster-domain="" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836982 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836986 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836989 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836992 2563 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836995 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 23:22:24.842271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.836998 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837001 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837005 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837009 2563 flags.go:64] FLAG: --contention-profiling="false" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837012 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837015 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837018 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837021 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837025 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837028 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837031 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837034 2563 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837037 2563 flags.go:64] FLAG: --enable-server="true" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837040 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837045 2563 flags.go:64] FLAG: --event-burst="100" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837048 2563 flags.go:64] FLAG: --event-qps="50" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837051 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837054 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837057 2563 flags.go:64] FLAG: --eviction-hard="" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837061 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837063 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837066 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837071 2563 flags.go:64] FLAG: --eviction-soft="" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837074 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837076 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 23:22:24.842848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837080 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837083 2563 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837086 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837088 2563 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837092 2563 flags.go:64] FLAG: --feature-gates="" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837095 2563 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837098 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837101 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837104 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837107 2563 flags.go:64] FLAG: --healthz-port="10248" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837112 2563 flags.go:64] FLAG: --help="false" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837114 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-79.ec2.internal" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837117 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837120 2563 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837123 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837126 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837130 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837147 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837150 2563 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837153 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837156 2563 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837160 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837163 2563 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837166 2563 flags.go:64] FLAG: --kube-reserved="" Sep 09 23:22:24.843475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837168 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837171 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837174 2563 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837177 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837180 2563 flags.go:64] FLAG: --lock-file="" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837184 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837187 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837190 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837195 2563 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837199 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837201 2563 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837204 2563 flags.go:64] FLAG: --logging-format="text" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837207 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837210 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837213 2563 flags.go:64] FLAG: --manifest-url="" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837216 2563 flags.go:64] FLAG: --manifest-url-header="" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837220 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837223 2563 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837228 2563 flags.go:64] FLAG: --max-pods="110" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837232 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837234 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837237 2563 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837240 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837243 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837246 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 23:22:24.844066 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837249 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837256 2563 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837260 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837263 2563 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837266 2563 flags.go:64] FLAG: --pod-cidr="" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837269 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837275 2563 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837278 2563 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837281 2563 flags.go:64] FLAG: --pods-per-core="0" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837284 2563 flags.go:64] FLAG: --port="10250" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837287 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837290 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05e3f3ac348cb05a3" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837295 2563 flags.go:64] FLAG: --qos-reserved="" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837298 2563 flags.go:64] FLAG: --read-only-port="10255" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837301 2563 flags.go:64] FLAG: --register-node="true" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837303 2563 flags.go:64] FLAG: --register-with-taints="" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837307 2563 flags.go:64] FLAG: --registry-burst="10" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837310 2563 flags.go:64] FLAG: --registry-qps="5" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837313 2563 flags.go:64] FLAG: --reserved-cpus="" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837316 2563 flags.go:64] FLAG: --reserved-memory="" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837319 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837323 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837325 2563 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837328 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837331 2563 flags.go:64] FLAG: --runonce="false" Sep 09 23:22:24.844695 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837334 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837338 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837341 2563 flags.go:64] FLAG: --seccomp-default="false" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837344 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837348 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837351 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837354 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837357 2563 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837360 2563 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837363 2563 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837366 2563 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837369 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837372 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837375 2563 flags.go:64] FLAG: --system-cgroups="" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837378 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837383 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837386 2563 flags.go:64] FLAG: --tls-cert-file="" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837389 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837393 2563 flags.go:64] FLAG: --tls-min-version="" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837397 2563 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837399 2563 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837402 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837405 2563 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837408 2563 flags.go:64] FLAG: --v="2" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837412 2563 flags.go:64] FLAG: --version="false" Sep 09 23:22:24.845391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837417 2563 flags.go:64] FLAG: --vmodule="" Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837421 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.837424 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837538 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837542 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837546 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837550 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837553 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837557 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837560 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837563 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837566 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837569 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837572 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837575 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837577 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837580 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837583 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837586 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837589 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:22:24.845989 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837591 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837594 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837596 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837599 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837602 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837604 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837607 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837609 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837612 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837615 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837617 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837620 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837623 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837626 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837628 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837631 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837634 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837636 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837639 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837642 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:22:24.846534 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837646 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837648 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837652 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837656 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837659 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837662 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837665 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837676 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837679 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837682 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837686 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837689 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837691 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837694 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837696 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837699 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837702 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837704 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837707 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:22:24.847022 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837710 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837713 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837715 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837718 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837720 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837723 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837725 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837728 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837731 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837733 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837736 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837739 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837741 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837745 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837748 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837750 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837753 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837755 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837758 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837760 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:22:24.847504 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837763 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837766 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837768 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837771 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837774 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837776 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837779 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837782 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837784 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837787 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837789 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837792 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837795 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837797 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837800 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837803 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837805 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837808 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837811 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:22:24.847987 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837814 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837817 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837820 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.837822 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.838430 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.845962 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.845977 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.846597 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.846605 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846670 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846675 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846679 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846682 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846685 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846689 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:22:24.848469 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846692 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846695 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846698 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846700 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846704 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846708 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846712 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846715 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846717 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846720 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846723 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846725 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846728 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846731 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846733 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846736 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846738 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846741 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846744 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:22:24.848848 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846746 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846748 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846751 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846754 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846758 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846761 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846763 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846766 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846769 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846771 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846774 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846776 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846779 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846782 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846785 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846787 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846789 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846792 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846795 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846797 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:22:24.849386 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846800 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846802 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846806 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846810 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846813 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846815 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846818 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846820 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846823 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846826 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846829 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846831 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846834 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846837 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846839 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846842 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846845 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846854 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846857 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:22:24.849898 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846860 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846864 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846867 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846871 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846874 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846876 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846879 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846882 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846884 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846887 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846890 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846892 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846895 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846898 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846901 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846903 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846906 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846908 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846911 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:22:24.850366 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846914 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846916 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846920 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846922 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846925 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846928 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846930 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846933 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846936 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846938 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846941 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846944 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846952 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846955 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846958 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:22:24.850823 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.846960 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.846965 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847104 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847109 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847112 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847115 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847118 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847120 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847123 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847126 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847128 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847146 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847150 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847153 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847155 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:22:24.851197 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847158 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847160 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847163 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847166 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847168 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847171 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847173 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847176 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847179 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847181 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847184 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847186 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847190 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847193 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847196 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847205 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847208 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847210 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847214 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:22:24.851588 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847218 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847220 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847224 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847228 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847231 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847234 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847237 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847240 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847243 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847246 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847248 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847251 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847253 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847256 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847258 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847261 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847263 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847266 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847270 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:22:24.852028 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847274 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847276 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847279 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847282 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847284 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847287 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847289 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847292 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847295 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847297 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847306 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847309 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847312 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847314 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847317 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847319 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847322 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847324 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847327 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847329 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:22:24.852505 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847331 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847334 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847337 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847339 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847341 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847344 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847346 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847349 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847351 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847353 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847356 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847359 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847361 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847364 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847366 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847369 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847371 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847374 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847376 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847379 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:22:24.852991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847381 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847384 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847386 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847394 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847397 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847400 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847402 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:24.847405 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.847410 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.847558 2563 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.849733 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.850593 2563 server.go:1019] "Starting client certificate rotation" Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.850686 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:22:24.853613 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.851470 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:22:24.853949 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.853097 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:22:24.854520 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.854503 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:22:24.869194 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.869173 2563 log.go:25] "Validated CRI v1 runtime API" Sep 09 23:22:24.872184 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.872167 2563 log.go:25] "Validated CRI v1 image API" Sep 09 23:22:24.873012 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.872993 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 23:22:24.876524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.876503 2563 fs.go:135] Filesystem UUIDs: map[3687eaed-ef02-4a6b-9203-32326c1134da:/dev/nvme0n1p3 5ddcfb0c-4152-41ec-b5a9-734db11973cb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 09 23:22:24.876607 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.876522 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 23:22:24.881253 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.881234 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:22:24.882925 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.882808 2563 manager.go:216] Machine: {Timestamp:2026-09-09 23:22:24.880710135 +0000 UTC m=+0.300613870 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3135265 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21e85a551c62911aa79b274746c096 SystemUUID:ec21e85a-551c-6291-1aa7-9b274746c096 BootID:0c429f03-d479-41f4-be1f-0165f91ad4ca Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f3:aa:28:58:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f3:aa:28:58:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:7b:a3:7d:68:14 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 23:22:24.882925 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.882923 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 23:22:24.883035 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.883008 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 23:22:24.885897 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.885876 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 23:22:24.886041 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.885899 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-79.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 23:22:24.887226 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.887215 2563 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 23:22:24.887265 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.887229 2563 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 23:22:24.887265 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.887237 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:22:24.887905 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.887895 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:22:24.889704 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.889693 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 23:22:24.894109 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.894096 2563 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:22:24.894243 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.894233 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 23:22:24.894296 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.894270 2563 kubelet.go:486] "Attempting to sync node with API server" Sep 09 23:22:24.894296 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.894291 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 23:22:24.894369 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.894302 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 23:22:24.894369 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.894313 2563 kubelet.go:398] "Adding apiserver pod source" Sep 09 23:22:24.894369 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.894323 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 23:22:24.894834 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.894815 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:22:24.894919 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.894837 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:22:24.896957 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.896939 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 23:22:24.899696 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.899683 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 23:22:24.899764 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.899712 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 23:22:24.899896 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.899887 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 23:22:24.899926 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.899902 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 23:22:24.899926 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.899908 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 23:22:24.899926 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.899921 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 23:22:24.900004 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.899933 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 23:22:24.900004 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.899939 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 23:22:24.900386 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.900377 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 23:22:24.900386 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.900386 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 23:22:24.900447 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.900392 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 23:22:24.900447 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.900398 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 23:22:24.900447 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.900415 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 23:22:24.900447 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.900422 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 23:22:24.901179 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.901168 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 23:22:24.901212 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.901182 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 23:22:24.901304 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.901282 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4znc8" Sep 09 23:22:24.904639 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.904403 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-79.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 23:22:24.904639 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:24.904470 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 23:22:24.904639 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:24.904611 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 23:22:24.906817 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.906803 2563 server.go:1268] "Started kubelet" Sep 09 23:22:24.906899 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.906874 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 23:22:24.906985 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.906934 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 23:22:24.907023 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.907009 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 23:22:24.907673 ip-10-0-136-79 systemd[1]: Started Kubernetes Kubelet. Sep 09 23:22:24.908737 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.908720 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 23:22:24.908869 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.908855 2563 server.go:310] "Adding debug handlers to kubelet server" Sep 09 23:22:24.909272 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.909250 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4znc8" Sep 09 23:22:24.911392 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:24.911369 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 23:22:24.914388 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.914372 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 23:22:24.914455 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.914391 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 23:22:24.914504 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:24.914482 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:24.915227 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915071 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 23:22:24.915227 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915153 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 23:22:24.915227 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915167 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 23:22:24.915227 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915224 2563 factory.go:55] Registering systemd factory Sep 09 23:22:24.915415 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915238 2563 factory.go:223] Registration of the systemd container factory successfully Sep 09 23:22:24.915415 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915260 2563 reconstruct.go:97] "Volume reconstruction finished" Sep 09 23:22:24.915415 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915267 2563 reconciler.go:29] "Reconciler: start to sync state" Sep 09 23:22:24.915552 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915497 2563 factory.go:153] Registering CRI-O factory Sep 09 23:22:24.915552 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915510 2563 factory.go:223] Registration of the crio container factory successfully Sep 09 23:22:24.915640 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915564 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 23:22:24.915640 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915588 2563 factory.go:103] Registering Raw factory Sep 09 23:22:24.915640 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915604 2563 manager.go:1196] Started watching for new ooms in manager Sep 09 23:22:24.915998 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.915984 2563 manager.go:349] Starting recovery of all containers Sep 09 23:22:24.920639 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.920618 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:22:24.923901 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:24.923880 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-79.ec2.internal\" not found" node="ip-10-0-136-79.ec2.internal" Sep 09 23:22:24.925903 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.925888 2563 manager.go:354] Recovery completed Sep 09 23:22:24.933599 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.933580 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:22:24.935330 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.935313 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:22:24.935423 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.935346 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:22:24.935423 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.935361 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:22:24.935965 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.935950 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:22:24.936058 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.935950 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 23:22:24.936058 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.936006 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 23:22:24.936058 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.936025 2563 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:22:24.936750 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.936734 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:22:24.936818 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.936771 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:22:24.936818 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.936786 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:22:24.938111 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.938099 2563 policy_none.go:49] "None policy: Start" Sep 09 23:22:24.938182 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.938114 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 23:22:24.938182 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.938128 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 23:22:24.940229 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.940216 2563 policy_none.go:47] "Start" Sep 09 23:22:24.968751 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.968736 2563 manager.go:337] "Starting Device Plugin manager" Sep 09 23:22:24.989436 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:24.968771 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 23:22:24.989436 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.968781 2563 server.go:87] "Starting device plugin registration server" Sep 09 23:22:24.989436 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.969120 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 23:22:24.989436 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.969149 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 23:22:24.989436 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.969217 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 23:22:24.989436 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.969297 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 23:22:24.989436 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:24.969304 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 23:22:24.989436 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:24.969906 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 23:22:24.989436 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:24.969955 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:25.058057 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.058011 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 23:22:25.059252 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.059225 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 23:22:25.059371 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.059297 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 23:22:25.059371 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.059329 2563 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 23:22:25.059448 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:25.059385 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 23:22:25.061575 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.061549 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:22:25.069354 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.069339 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:22:25.070225 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.070207 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:22:25.070323 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.070240 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:22:25.070323 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.070251 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:22:25.070323 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.070273 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.079409 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.079345 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.079409 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:25.079364 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-79.ec2.internal\": node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:25.097120 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:25.097099 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:25.160478 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.160431 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-79.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal"] Sep 09 23:22:25.160614 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.160546 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:22:25.161586 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.161570 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:22:25.161680 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.161598 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:22:25.161680 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.161608 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:22:25.163899 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.163887 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:22:25.164029 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.164015 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.164065 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.164045 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:22:25.165480 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.165466 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:22:25.165559 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.165469 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:22:25.165559 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.165495 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:22:25.165559 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.165509 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:22:25.165559 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.165513 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:22:25.165559 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.165528 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:22:25.167713 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.167700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.167778 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.167725 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:22:25.168506 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.168486 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:22:25.168596 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.168515 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:22:25.168596 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.168528 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:22:25.187776 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:25.187755 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-79.ec2.internal\" not found" node="ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.192183 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:25.192168 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-79.ec2.internal\" not found" node="ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.197268 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:25.197249 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:25.216719 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.216698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b05a491c1df21a93085da4fdaf3acb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-79.ec2.internal\" (UID: \"b05a491c1df21a93085da4fdaf3acb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.216796 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.216732 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/801cc8199b4f317b05b6892222bee30b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal\" (UID: \"801cc8199b4f317b05b6892222bee30b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.216796 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.216749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/801cc8199b4f317b05b6892222bee30b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal\" (UID: \"801cc8199b4f317b05b6892222bee30b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.297892 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:25.297855 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:25.317267 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.317235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/801cc8199b4f317b05b6892222bee30b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal\" (UID: \"801cc8199b4f317b05b6892222bee30b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.317359 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.317287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b05a491c1df21a93085da4fdaf3acb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-79.ec2.internal\" (UID: \"b05a491c1df21a93085da4fdaf3acb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.317359 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.317321 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b05a491c1df21a93085da4fdaf3acb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-79.ec2.internal\" (UID: \"b05a491c1df21a93085da4fdaf3acb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.317359 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.317310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/801cc8199b4f317b05b6892222bee30b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal\" (UID: \"801cc8199b4f317b05b6892222bee30b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.317359 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.317286 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/801cc8199b4f317b05b6892222bee30b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal\" (UID: \"801cc8199b4f317b05b6892222bee30b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.317495 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:25.317377 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/801cc8199b4f317b05b6892222bee30b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal\" (UID: \"801cc8199b4f317b05b6892222bee30b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" Sep 09 23:22:25.398748 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:25.398653 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:26.618436 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:26.618394 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-79.ec2.internal" Sep 09 23:22:26.622682 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:26.622660 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" Sep 09 23:22:26.626533 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:26.626513 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:26.727227 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:26.727179 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:26.827726 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:26.827665 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:26.928194 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:26.928160 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:26.966268 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:26.966238 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:22:26.978269 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:26.978233 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 23:22:26.978406 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:26.978389 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:22:26.978446 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:26.978407 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:22:26.978446 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:26.978409 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:22:27.028730 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:27.028697 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:27.042915 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:27.042883 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:17:26 +0000 UTC" deadline="2028-02-19 07:09:48.074201252 +0000 UTC" Sep 09 23:22:27.042915 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:27.042914 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12655h47m21.031291697s" Sep 09 23:22:27.129583 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:27.129515 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:27.210711 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:27.210670 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801cc8199b4f317b05b6892222bee30b.slice/crio-e0619a0e7e6f93aa0cc1db96b2c231e57a4daf71217a159b6a584199d00101cd WatchSource:0}: Error finding container e0619a0e7e6f93aa0cc1db96b2c231e57a4daf71217a159b6a584199d00101cd: Status 404 returned error can't find the container with id e0619a0e7e6f93aa0cc1db96b2c231e57a4daf71217a159b6a584199d00101cd Sep 09 23:22:27.210914 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:27.210895 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05a491c1df21a93085da4fdaf3acb4e.slice/crio-0941b0f893ff3d437f9f285f86d0879dfadf8bcd1cb6c5f5599dc1c2cac7e1b3 WatchSource:0}: Error finding container 0941b0f893ff3d437f9f285f86d0879dfadf8bcd1cb6c5f5599dc1c2cac7e1b3: Status 404 returned error can't find the container with id 0941b0f893ff3d437f9f285f86d0879dfadf8bcd1cb6c5f5599dc1c2cac7e1b3 Sep 09 23:22:27.215493 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:27.215475 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:22:27.230163 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:27.230142 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:27.330713 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:27.330666 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:27.431204 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:27.431129 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-79.ec2.internal\" not found" Sep 09 23:22:27.500608 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:27.500578 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:22:27.541965 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:27.541934 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-79.ec2.internal" Sep 09 23:22:27.550601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:27.550582 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:22:27.551574 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:27.551561 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" Sep 09 23:22:27.560290 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:27.560266 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:22:28.008691 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.008655 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:22:28.022627 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.022596 2563 apiserver.go:52] "Watching apiserver" Sep 09 23:22:28.031791 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.031761 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 23:22:28.032164 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.032139 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-fpqb4","openshift-multus/network-metrics-daemon-7cdh4","openshift-network-operator/iptables-alerter-9rlkq","kube-system/konnectivity-agent-wgbgm","kube-system/kube-apiserver-proxy-ip-10-0-136-79.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs","openshift-multus/multus-5vgg9","openshift-network-diagnostics/network-check-target-pvbp9","openshift-ovn-kubernetes/ovnkube-node-v2rnn","kube-system/global-pull-secret-syncer-hkq6b","openshift-cluster-node-tuning-operator/tuned-8jnbm","openshift-dns/node-resolver-6qqj6","openshift-image-registry/node-ca-kmnm2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal"] Sep 09 23:22:28.034782 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.034752 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.037165 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.037127 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 23:22:28.037275 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.037201 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 23:22:28.037275 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.037135 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 23:22:28.037418 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.037374 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.037861 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.037840 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 23:22:28.037959 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.037893 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2wtft\"" Sep 09 23:22:28.039476 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.039455 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kwlb8\"" Sep 09 23:22:28.039724 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.039707 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 23:22:28.039788 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.039770 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:22:28.040006 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.039983 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9rlkq" Sep 09 23:22:28.042997 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.042155 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:28.042997 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.042907 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:22:28.042997 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.042945 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 23:22:28.042997 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.042979 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 23:22:28.043233 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.043127 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 23:22:28.043677 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.043385 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dpd57\"" Sep 09 23:22:28.044406 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.044302 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 23:22:28.044513 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.044426 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:28.044513 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.044504 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:28.044664 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.044647 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pjczz\"" Sep 09 23:22:28.044761 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.044743 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 23:22:28.047231 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.047154 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.049563 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.049544 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 23:22:28.049864 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.049844 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.050442 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.050421 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 23:22:28.050776 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.050753 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 23:22:28.050871 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.050851 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-55b46\"" Sep 09 23:22:28.052207 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.052189 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kmnm2" Sep 09 23:22:28.053786 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.053619 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 23:22:28.053786 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.053645 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ddwqb\"" Sep 09 23:22:28.053786 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.053651 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 23:22:28.053786 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.053763 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 23:22:28.054046 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.053867 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 23:22:28.054046 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-var-lib-cni-multus\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.054155 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054052 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-sysctl-conf\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.054155 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7883b927-9bb9-486b-942c-f4174f625009-tmp\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.054155 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c203b67d-ccdf-4ab8-ae1c-e4fa792dd123-konnectivity-ca\") pod \"konnectivity-agent-wgbgm\" (UID: \"c203b67d-ccdf-4ab8-ae1c-e4fa792dd123\") " pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:28.054155 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054125 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-run-netns\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.054155 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-var-lib-kubelet\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.054431 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-hostroot\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.054431 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-conf-dir\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.054431 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-sys\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.054431 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6z57\" (UniqueName: \"kubernetes.io/projected/7883b927-9bb9-486b-942c-f4174f625009-kube-api-access-h6z57\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.054431 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-cnibin\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.054431 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-sysctl-d\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.054431 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-systemd\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.054431 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054352 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-lib-modules\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.054431 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054374 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c203b67d-ccdf-4ab8-ae1c-e4fa792dd123-agent-certs\") pod \"konnectivity-agent-wgbgm\" (UID: \"c203b67d-ccdf-4ab8-ae1c-e4fa792dd123\") " pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:28.054431 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-system-cni-dir\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-run-multus-certs\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054486 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-modprobe-d\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-run\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e28e30a1-f921-4eca-a164-31765eed74df-host-slash\") pod \"iptables-alerter-9rlkq\" (UID: \"e28e30a1-f921-4eca-a164-31765eed74df\") " pod="openshift-network-operator/iptables-alerter-9rlkq" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhz2l\" (UniqueName: \"kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l\") pod \"network-check-target-pvbp9\" (UID: \"d12e593f-3c8d-43b4-91de-74e053cfbf13\") " pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054590 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-var-lib-kubelet\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7883b927-9bb9-486b-942c-f4174f625009-etc-tuned\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97fc02db-0c12-40dd-b385-ddc20d26adea-cni-binary-copy\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-var-lib-cni-bin\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-daemon-config\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054717 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-etc-kubernetes\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqndh\" (UniqueName: \"kubernetes.io/projected/e28e30a1-f921-4eca-a164-31765eed74df-kube-api-access-kqndh\") pod \"iptables-alerter-9rlkq\" (UID: \"e28e30a1-f921-4eca-a164-31765eed74df\") " pod="openshift-network-operator/iptables-alerter-9rlkq" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054799 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-cni-dir\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-socket-dir-parent\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-run-k8s-cni-cncf-io\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8srhf\" (UniqueName: \"kubernetes.io/projected/97fc02db-0c12-40dd-b385-ddc20d26adea-kube-api-access-8srhf\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.055013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054901 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 23:22:28.055828 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-sysconfig\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.055828 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-host\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.055828 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.054963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-kubernetes\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.055828 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.055005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e28e30a1-f921-4eca-a164-31765eed74df-iptables-alerter-script\") pod \"iptables-alerter-9rlkq\" (UID: \"e28e30a1-f921-4eca-a164-31765eed74df\") " pod="openshift-network-operator/iptables-alerter-9rlkq" Sep 09 23:22:28.055828 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.055488 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 23:22:28.055828 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.055770 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 23:22:28.056801 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.056778 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 23:22:28.059370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.057362 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:28.059370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.057531 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:22:28.059370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.058017 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 23:22:28.059370 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.058328 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:28.059370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.058391 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:28.059370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.058443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gpnj9\"" Sep 09 23:22:28.059370 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.058465 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:28.061255 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.061233 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.063425 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.063404 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xbdtl\"" Sep 09 23:22:28.063894 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.063853 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 23:22:28.064180 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.064163 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 23:22:28.064524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.064505 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6qqj6" Sep 09 23:22:28.066946 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.066727 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 23:22:28.066946 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.066737 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2tblq\"" Sep 09 23:22:28.066946 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.066869 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 23:22:28.074737 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.074717 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dsklg" Sep 09 23:22:28.082587 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.082565 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dsklg" Sep 09 23:22:28.143092 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.143063 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 23:22:28.155189 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8srhf\" (UniqueName: \"kubernetes.io/projected/97fc02db-0c12-40dd-b385-ddc20d26adea-kube-api-access-8srhf\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.155355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155194 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-sysconfig\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.155355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155220 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-host\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.155355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155251 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-slash\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.155355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-cni-bin\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.155355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0d01aef-6642-4f36-841c-4ffbeecd4d46-dbus\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:28.155355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/807e66ae-5942-4115-8fec-ba98c746c881-hosts-file\") pod \"node-resolver-6qqj6\" (UID: \"807e66ae-5942-4115-8fec-ba98c746c881\") " pod="openshift-dns/node-resolver-6qqj6" Sep 09 23:22:28.155666 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155368 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-host\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.155666 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155380 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-sysctl-conf\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.155666 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155381 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-sysconfig\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.155666 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7883b927-9bb9-486b-942c-f4174f625009-tmp\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.155666 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c203b67d-ccdf-4ab8-ae1c-e4fa792dd123-konnectivity-ca\") pod \"konnectivity-agent-wgbgm\" (UID: \"c203b67d-ccdf-4ab8-ae1c-e4fa792dd123\") " pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:28.155666 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttt5h\" (UniqueName: \"kubernetes.io/projected/4608d9a2-3736-484e-b2ea-08b699f70926-kube-api-access-ttt5h\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.155666 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155534 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-sysctl-conf\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.155666 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155639 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-run-netns\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-var-lib-kubelet\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-hostroot\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6z57\" (UniqueName: \"kubernetes.io/projected/7883b927-9bb9-486b-942c-f4174f625009-kube-api-access-h6z57\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155739 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcplc\" (UniqueName: \"kubernetes.io/projected/5094299e-d554-41d2-938d-d5ba8c6559ac-kube-api-access-pcplc\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155673 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-run-netns\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155778 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-var-lib-kubelet\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155786 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-hostroot\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-sysctl-d\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-systemd\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-lib-modules\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c203b67d-ccdf-4ab8-ae1c-e4fa792dd123-agent-certs\") pod \"konnectivity-agent-wgbgm\" (UID: \"c203b67d-ccdf-4ab8-ae1c-e4fa792dd123\") " pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155897 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-run-netns\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-run-systemd\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-run-openvswitch\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155943 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0d01aef-6642-4f36-841c-4ffbeecd4d46-kubelet-config\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155946 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c203b67d-ccdf-4ab8-ae1c-e4fa792dd123-konnectivity-ca\") pod \"konnectivity-agent-wgbgm\" (UID: \"c203b67d-ccdf-4ab8-ae1c-e4fa792dd123\") " pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:28.155992 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155958 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-system-cni-dir\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.155987 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-run-multus-certs\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-modprobe-d\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-run\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156030 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-systemd\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e28e30a1-f921-4eca-a164-31765eed74df-host-slash\") pod \"iptables-alerter-9rlkq\" (UID: \"e28e30a1-f921-4eca-a164-31765eed74df\") " pod="openshift-network-operator/iptables-alerter-9rlkq" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhz2l\" (UniqueName: \"kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l\") pod \"network-check-target-pvbp9\" (UID: \"d12e593f-3c8d-43b4-91de-74e053cfbf13\") " pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5094299e-d554-41d2-938d-d5ba8c6559ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156105 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7883b927-9bb9-486b-942c-f4174f625009-etc-tuned\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-log-socket\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156146 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-lib-modules\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156146 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2357acc3-05fe-4e3b-92a7-7285db060886-env-overrides\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156188 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-run\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156203 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5094299e-d554-41d2-938d-d5ba8c6559ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156233 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156264 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e28e30a1-f921-4eca-a164-31765eed74df-host-slash\") pod \"iptables-alerter-9rlkq\" (UID: \"e28e30a1-f921-4eca-a164-31765eed74df\") " pod="openshift-network-operator/iptables-alerter-9rlkq" Sep 09 23:22:28.156816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156270 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-var-lib-cni-bin\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156298 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-etc-kubernetes\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqndh\" (UniqueName: \"kubernetes.io/projected/e28e30a1-f921-4eca-a164-31765eed74df-kube-api-access-kqndh\") pod \"iptables-alerter-9rlkq\" (UID: \"e28e30a1-f921-4eca-a164-31765eed74df\") " pod="openshift-network-operator/iptables-alerter-9rlkq" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-cni-netd\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156396 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-system-cni-dir\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156398 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5094299e-d554-41d2-938d-d5ba8c6559ac-system-cni-dir\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156402 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-run-multus-certs\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156235 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-sysctl-d\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-registration-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-cni-dir\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156484 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-var-lib-cni-bin\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156494 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-modprobe-d\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-socket-dir-parent\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-run-k8s-cni-cncf-io\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156537 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-socket-dir-parent\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156558 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-var-lib-openvswitch\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5094299e-d554-41d2-938d-d5ba8c6559ac-cnibin\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.157601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156594 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-cni-dir\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ccf608c-06db-4253-bab5-c1ee922617a0-host\") pod \"node-ca-kmnm2\" (UID: \"2ccf608c-06db-4253-bab5-c1ee922617a0\") " pod="openshift-image-registry/node-ca-kmnm2" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156639 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-kubernetes\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e28e30a1-f921-4eca-a164-31765eed74df-iptables-alerter-script\") pod \"iptables-alerter-9rlkq\" (UID: \"e28e30a1-f921-4eca-a164-31765eed74df\") " pod="openshift-network-operator/iptables-alerter-9rlkq" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156663 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-run-k8s-cni-cncf-io\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156622 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-etc-kubernetes\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156689 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-run-ovn\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-run-ovn-kubernetes\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156732 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-etc-kubernetes\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqdh4\" (UniqueName: \"kubernetes.io/projected/807e66ae-5942-4115-8fec-ba98c746c881-kube-api-access-lqdh4\") pod \"node-resolver-6qqj6\" (UID: \"807e66ae-5942-4115-8fec-ba98c746c881\") " pod="openshift-dns/node-resolver-6qqj6" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-var-lib-cni-multus\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-conf-dir\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-sys\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-kubelet\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156829 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-host-var-lib-cni-multus\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-node-log\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.158411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156876 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-conf-dir\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btclg\" (UniqueName: \"kubernetes.io/projected/2357acc3-05fe-4e3b-92a7-7285db060886-kube-api-access-btclg\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156900 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-sys\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156925 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5094299e-d554-41d2-938d-d5ba8c6559ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-cnibin\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.156997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157050 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97fc02db-0c12-40dd-b385-ddc20d26adea-cnibin\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5094299e-d554-41d2-938d-d5ba8c6559ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157086 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-socket-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ccf608c-06db-4253-bab5-c1ee922617a0-serviceca\") pod \"node-ca-kmnm2\" (UID: \"2ccf608c-06db-4253-bab5-c1ee922617a0\") " pod="openshift-image-registry/node-ca-kmnm2" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157145 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2357acc3-05fe-4e3b-92a7-7285db060886-ovnkube-script-lib\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807e66ae-5942-4115-8fec-ba98c746c881-tmp-dir\") pod \"node-resolver-6qqj6\" (UID: \"807e66ae-5942-4115-8fec-ba98c746c881\") " pod="openshift-dns/node-resolver-6qqj6" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-device-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvkpr\" (UniqueName: \"kubernetes.io/projected/2ccf608c-06db-4253-bab5-c1ee922617a0-kube-api-access-hvkpr\") pod \"node-ca-kmnm2\" (UID: \"2ccf608c-06db-4253-bab5-c1ee922617a0\") " pod="openshift-image-registry/node-ca-kmnm2" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-var-lib-kubelet\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pshs2\" (UniqueName: \"kubernetes.io/projected/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-kube-api-access-pshs2\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-systemd-units\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.159083 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157357 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7883b927-9bb9-486b-942c-f4174f625009-var-lib-kubelet\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.159889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-etc-openvswitch\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.159889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.159889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2357acc3-05fe-4e3b-92a7-7285db060886-ovn-node-metrics-cert\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.159889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-sys-fs\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.159889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97fc02db-0c12-40dd-b385-ddc20d26adea-cni-binary-copy\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.159889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157521 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e28e30a1-f921-4eca-a164-31765eed74df-iptables-alerter-script\") pod \"iptables-alerter-9rlkq\" (UID: \"e28e30a1-f921-4eca-a164-31765eed74df\") " pod="openshift-network-operator/iptables-alerter-9rlkq" Sep 09 23:22:28.159889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157603 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-daemon-config\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.159889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157634 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2357acc3-05fe-4e3b-92a7-7285db060886-ovnkube-config\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.159889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.157668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:28.159889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.158160 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97fc02db-0c12-40dd-b385-ddc20d26adea-multus-daemon-config\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.159889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.158571 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97fc02db-0c12-40dd-b385-ddc20d26adea-cni-binary-copy\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.160425 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.159998 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7883b927-9bb9-486b-942c-f4174f625009-etc-tuned\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.160425 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.160029 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7883b927-9bb9-486b-942c-f4174f625009-tmp\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.160898 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.160877 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c203b67d-ccdf-4ab8-ae1c-e4fa792dd123-agent-certs\") pod \"konnectivity-agent-wgbgm\" (UID: \"c203b67d-ccdf-4ab8-ae1c-e4fa792dd123\") " pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:28.161177 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.161153 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:22:28.161264 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.161181 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:22:28.161264 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.161195 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xhz2l for pod openshift-network-diagnostics/network-check-target-pvbp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:28.161264 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.161260 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l podName:d12e593f-3c8d-43b4-91de-74e053cfbf13 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:28.661241183 +0000 UTC m=+2.953971739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xhz2l" (UniqueName: "kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l") pod "network-check-target-pvbp9" (UID: "d12e593f-3c8d-43b4-91de-74e053cfbf13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:28.163230 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.163143 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8srhf\" (UniqueName: \"kubernetes.io/projected/97fc02db-0c12-40dd-b385-ddc20d26adea-kube-api-access-8srhf\") pod \"multus-5vgg9\" (UID: \"97fc02db-0c12-40dd-b385-ddc20d26adea\") " pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.163230 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.163216 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6z57\" (UniqueName: \"kubernetes.io/projected/7883b927-9bb9-486b-942c-f4174f625009-kube-api-access-h6z57\") pod \"tuned-8jnbm\" (UID: \"7883b927-9bb9-486b-942c-f4174f625009\") " pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.164085 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.164062 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqndh\" (UniqueName: \"kubernetes.io/projected/e28e30a1-f921-4eca-a164-31765eed74df-kube-api-access-kqndh\") pod \"iptables-alerter-9rlkq\" (UID: \"e28e30a1-f921-4eca-a164-31765eed74df\") " pod="openshift-network-operator/iptables-alerter-9rlkq" Sep 09 23:22:28.195578 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.195488 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-79.ec2.internal" event={"ID":"b05a491c1df21a93085da4fdaf3acb4e","Type":"ContainerStarted","Data":"0941b0f893ff3d437f9f285f86d0879dfadf8bcd1cb6c5f5599dc1c2cac7e1b3"} Sep 09 23:22:28.196712 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.196688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" event={"ID":"801cc8199b4f317b05b6892222bee30b","Type":"ContainerStarted","Data":"e0619a0e7e6f93aa0cc1db96b2c231e57a4daf71217a159b6a584199d00101cd"} Sep 09 23:22:28.258862 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.258768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5094299e-d554-41d2-938d-d5ba8c6559ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.258862 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.258809 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-log-socket\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.258862 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.258827 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2357acc3-05fe-4e3b-92a7-7285db060886-env-overrides\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.258862 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.258848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5094299e-d554-41d2-938d-d5ba8c6559ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.258872 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.258896 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-log-socket\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.258901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-cni-netd\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.258937 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-cni-netd\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.258951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5094299e-d554-41d2-938d-d5ba8c6559ac-system-cni-dir\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.258978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-registration-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-var-lib-openvswitch\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259022 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5094299e-d554-41d2-938d-d5ba8c6559ac-cnibin\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259042 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5094299e-d554-41d2-938d-d5ba8c6559ac-system-cni-dir\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259047 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259057 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259083 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5094299e-d554-41d2-938d-d5ba8c6559ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259095 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ccf608c-06db-4253-bab5-c1ee922617a0-host\") pod \"node-ca-kmnm2\" (UID: \"2ccf608c-06db-4253-bab5-c1ee922617a0\") " pod="openshift-image-registry/node-ca-kmnm2" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259104 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ccf608c-06db-4253-bab5-c1ee922617a0-host\") pod \"node-ca-kmnm2\" (UID: \"2ccf608c-06db-4253-bab5-c1ee922617a0\") " pod="openshift-image-registry/node-ca-kmnm2" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-run-ovn\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259132 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-var-lib-openvswitch\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259141 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-registration-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259145 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5094299e-d554-41d2-938d-d5ba8c6559ac-cnibin\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259167 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-run-ovn\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-run-ovn-kubernetes\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259194 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-run-ovn-kubernetes\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqdh4\" (UniqueName: \"kubernetes.io/projected/807e66ae-5942-4115-8fec-ba98c746c881-kube-api-access-lqdh4\") pod \"node-resolver-6qqj6\" (UID: \"807e66ae-5942-4115-8fec-ba98c746c881\") " pod="openshift-dns/node-resolver-6qqj6" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-kubelet\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-node-log\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btclg\" (UniqueName: \"kubernetes.io/projected/2357acc3-05fe-4e3b-92a7-7285db060886-kube-api-access-btclg\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259298 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-kubelet\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259322 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5094299e-d554-41d2-938d-d5ba8c6559ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259301 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-node-log\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259381 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2357acc3-05fe-4e3b-92a7-7285db060886-env-overrides\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5094299e-d554-41d2-938d-d5ba8c6559ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259471 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5094299e-d554-41d2-938d-d5ba8c6559ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.259947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-socket-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ccf608c-06db-4253-bab5-c1ee922617a0-serviceca\") pod \"node-ca-kmnm2\" (UID: \"2ccf608c-06db-4253-bab5-c1ee922617a0\") " pod="openshift-image-registry/node-ca-kmnm2" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.259539 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2357acc3-05fe-4e3b-92a7-7285db060886-ovnkube-script-lib\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807e66ae-5942-4115-8fec-ba98c746c881-tmp-dir\") pod \"node-resolver-6qqj6\" (UID: \"807e66ae-5942-4115-8fec-ba98c746c881\") " pod="openshift-dns/node-resolver-6qqj6" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.259619 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs podName:b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c nodeName:}" failed. No retries permitted until 2026-09-09 23:22:28.75958999 +0000 UTC m=+3.052320561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs") pod "network-metrics-daemon-7cdh4" (UID: "b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-device-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259671 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvkpr\" (UniqueName: \"kubernetes.io/projected/2ccf608c-06db-4253-bab5-c1ee922617a0-kube-api-access-hvkpr\") pod \"node-ca-kmnm2\" (UID: \"2ccf608c-06db-4253-bab5-c1ee922617a0\") " pod="openshift-image-registry/node-ca-kmnm2" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pshs2\" (UniqueName: \"kubernetes.io/projected/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-kube-api-access-pshs2\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259717 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-socket-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-systemd-units\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259750 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-etc-openvswitch\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259808 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807e66ae-5942-4115-8fec-ba98c746c881-tmp-dir\") pod \"node-resolver-6qqj6\" (UID: \"807e66ae-5942-4115-8fec-ba98c746c881\") " pod="openshift-dns/node-resolver-6qqj6" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259844 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-systemd-units\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259844 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-etc-openvswitch\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2357acc3-05fe-4e3b-92a7-7285db060886-ovn-node-metrics-cert\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.260774 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259858 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5094299e-d554-41d2-938d-d5ba8c6559ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259870 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-sys-fs\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-device-dir\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2357acc3-05fe-4e3b-92a7-7285db060886-ovnkube-config\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259895 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259947 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4608d9a2-3736-484e-b2ea-08b699f70926-sys-fs\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.259980 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5094299e-d554-41d2-938d-d5ba8c6559ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260047 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-slash\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.260064 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-cni-bin\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0d01aef-6642-4f36-841c-4ffbeecd4d46-dbus\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.260112 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret podName:e0d01aef-6642-4f36-841c-4ffbeecd4d46 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:28.760096664 +0000 UTC m=+3.052827221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret") pod "global-pull-secret-syncer-hkq6b" (UID: "e0d01aef-6642-4f36-841c-4ffbeecd4d46") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/807e66ae-5942-4115-8fec-ba98c746c881-hosts-file\") pod \"node-resolver-6qqj6\" (UID: \"807e66ae-5942-4115-8fec-ba98c746c881\") " pod="openshift-dns/node-resolver-6qqj6" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260157 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0d01aef-6642-4f36-841c-4ffbeecd4d46-dbus\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260172 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-slash\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260176 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttt5h\" (UniqueName: \"kubernetes.io/projected/4608d9a2-3736-484e-b2ea-08b699f70926-kube-api-access-ttt5h\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.261630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260198 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-cni-bin\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260221 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcplc\" (UniqueName: \"kubernetes.io/projected/5094299e-d554-41d2-938d-d5ba8c6559ac-kube-api-access-pcplc\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260224 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ccf608c-06db-4253-bab5-c1ee922617a0-serviceca\") pod \"node-ca-kmnm2\" (UID: \"2ccf608c-06db-4253-bab5-c1ee922617a0\") " pod="openshift-image-registry/node-ca-kmnm2" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-run-netns\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260253 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/807e66ae-5942-4115-8fec-ba98c746c881-hosts-file\") pod \"node-resolver-6qqj6\" (UID: \"807e66ae-5942-4115-8fec-ba98c746c881\") " pod="openshift-dns/node-resolver-6qqj6" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-run-systemd\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-run-openvswitch\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0d01aef-6642-4f36-841c-4ffbeecd4d46-kubelet-config\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260297 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-host-run-netns\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260377 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-run-openvswitch\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260380 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0d01aef-6642-4f36-841c-4ffbeecd4d46-kubelet-config\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260391 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2357acc3-05fe-4e3b-92a7-7285db060886-ovnkube-config\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260402 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2357acc3-05fe-4e3b-92a7-7285db060886-run-systemd\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.262432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.260391 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2357acc3-05fe-4e3b-92a7-7285db060886-ovnkube-script-lib\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.263049 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.262792 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2357acc3-05fe-4e3b-92a7-7285db060886-ovn-node-metrics-cert\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.268912 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.268887 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqdh4\" (UniqueName: \"kubernetes.io/projected/807e66ae-5942-4115-8fec-ba98c746c881-kube-api-access-lqdh4\") pod \"node-resolver-6qqj6\" (UID: \"807e66ae-5942-4115-8fec-ba98c746c881\") " pod="openshift-dns/node-resolver-6qqj6" Sep 09 23:22:28.269348 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.269333 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pshs2\" (UniqueName: \"kubernetes.io/projected/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-kube-api-access-pshs2\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:28.269427 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.269383 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcplc\" (UniqueName: \"kubernetes.io/projected/5094299e-d554-41d2-938d-d5ba8c6559ac-kube-api-access-pcplc\") pod \"multus-additional-cni-plugins-fpqb4\" (UID: \"5094299e-d554-41d2-938d-d5ba8c6559ac\") " pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.269427 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.269383 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttt5h\" (UniqueName: \"kubernetes.io/projected/4608d9a2-3736-484e-b2ea-08b699f70926-kube-api-access-ttt5h\") pod \"aws-ebs-csi-driver-node-cvfrs\" (UID: \"4608d9a2-3736-484e-b2ea-08b699f70926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.269994 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.269973 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvkpr\" (UniqueName: \"kubernetes.io/projected/2ccf608c-06db-4253-bab5-c1ee922617a0-kube-api-access-hvkpr\") pod \"node-ca-kmnm2\" (UID: \"2ccf608c-06db-4253-bab5-c1ee922617a0\") " pod="openshift-image-registry/node-ca-kmnm2" Sep 09 23:22:28.270111 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.270089 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btclg\" (UniqueName: \"kubernetes.io/projected/2357acc3-05fe-4e3b-92a7-7285db060886-kube-api-access-btclg\") pod \"ovnkube-node-v2rnn\" (UID: \"2357acc3-05fe-4e3b-92a7-7285db060886\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.347188 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.347156 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vgg9" Sep 09 23:22:28.356654 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.356492 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" Sep 09 23:22:28.366470 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.366444 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9rlkq" Sep 09 23:22:28.374130 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.374106 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:28.379875 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.379854 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" Sep 09 23:22:28.385655 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.385637 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:28.391295 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.391277 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kmnm2" Sep 09 23:22:28.396930 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.396914 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" Sep 09 23:22:28.401590 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.401570 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6qqj6" Sep 09 23:22:28.559670 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.559584 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:22:28.663527 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.663493 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhz2l\" (UniqueName: \"kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l\") pod \"network-check-target-pvbp9\" (UID: \"d12e593f-3c8d-43b4-91de-74e053cfbf13\") " pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:28.663690 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.663672 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:22:28.663744 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.663694 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:22:28.663744 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.663704 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xhz2l for pod openshift-network-diagnostics/network-check-target-pvbp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:28.663812 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.663763 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l podName:d12e593f-3c8d-43b4-91de-74e053cfbf13 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:29.66374671 +0000 UTC m=+3.956477253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhz2l" (UniqueName: "kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l") pod "network-check-target-pvbp9" (UID: "d12e593f-3c8d-43b4-91de-74e053cfbf13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:28.764658 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.764601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:28.764658 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.764660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:28.764873 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.764790 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:28.764873 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.764864 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs podName:b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c nodeName:}" failed. No retries permitted until 2026-09-09 23:22:29.764843829 +0000 UTC m=+4.057574388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs") pod "network-metrics-daemon-7cdh4" (UID: "b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:28.764997 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.764795 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:28.764997 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:28.764923 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret podName:e0d01aef-6642-4f36-841c-4ffbeecd4d46 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:29.76491043 +0000 UTC m=+4.057640987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret") pod "global-pull-secret-syncer-hkq6b" (UID: "e0d01aef-6642-4f36-841c-4ffbeecd4d46") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:28.911822 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:28.911739 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:22:29.085963 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.085932 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:17:28 +0000 UTC" deadline="2028-06-23 00:37:11.769688332 +0000 UTC" Sep 09 23:22:29.086251 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.085963 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15649h14m42.683729552s" Sep 09 23:22:29.100982 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:29.100957 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5094299e_d554_41d2_938d_d5ba8c6559ac.slice/crio-320154bf32cd1008dfc99f86dcac6f679a2dca4a2134671662d060cd6da89262 WatchSource:0}: Error finding container 320154bf32cd1008dfc99f86dcac6f679a2dca4a2134671662d060cd6da89262: Status 404 returned error can't find the container with id 320154bf32cd1008dfc99f86dcac6f679a2dca4a2134671662d060cd6da89262 Sep 09 23:22:29.102019 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:29.101999 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fc02db_0c12_40dd_b385_ddc20d26adea.slice/crio-6a4bcbaf7b6beb4a0831fefb5c895f37f27bb3ddd9d06541b9cba08bb3bc37cc WatchSource:0}: Error finding container 6a4bcbaf7b6beb4a0831fefb5c895f37f27bb3ddd9d06541b9cba08bb3bc37cc: Status 404 returned error can't find the container with id 6a4bcbaf7b6beb4a0831fefb5c895f37f27bb3ddd9d06541b9cba08bb3bc37cc Sep 09 23:22:29.102903 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:29.102811 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28e30a1_f921_4eca_a164_31765eed74df.slice/crio-63b630c1434fa0edf52d38f07b5fce6a4463a8ce6823c3e8c0d1e89482fd680b WatchSource:0}: Error finding container 63b630c1434fa0edf52d38f07b5fce6a4463a8ce6823c3e8c0d1e89482fd680b: Status 404 returned error can't find the container with id 63b630c1434fa0edf52d38f07b5fce6a4463a8ce6823c3e8c0d1e89482fd680b Sep 09 23:22:29.104097 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:29.104013 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7883b927_9bb9_486b_942c_f4174f625009.slice/crio-6c91ac51554698a9c33db82f8dab9401a9271fd94b9d2762d728c70ed84679d2 WatchSource:0}: Error finding container 6c91ac51554698a9c33db82f8dab9401a9271fd94b9d2762d728c70ed84679d2: Status 404 returned error can't find the container with id 6c91ac51554698a9c33db82f8dab9401a9271fd94b9d2762d728c70ed84679d2 Sep 09 23:22:29.106542 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:29.106424 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc203b67d_ccdf_4ab8_ae1c_e4fa792dd123.slice/crio-b96366abae26c31a7554242cdd31a20db93a36c7e5869343269dabcf03e42f1b WatchSource:0}: Error finding container b96366abae26c31a7554242cdd31a20db93a36c7e5869343269dabcf03e42f1b: Status 404 returned error can't find the container with id b96366abae26c31a7554242cdd31a20db93a36c7e5869343269dabcf03e42f1b Sep 09 23:22:29.107229 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:29.107197 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807e66ae_5942_4115_8fec_ba98c746c881.slice/crio-5aa468d4309d35571f2c6cd16d0cd515e743411c62e7ef6c1d09e0a6c13ea5b4 WatchSource:0}: Error finding container 5aa468d4309d35571f2c6cd16d0cd515e743411c62e7ef6c1d09e0a6c13ea5b4: Status 404 returned error can't find the container with id 5aa468d4309d35571f2c6cd16d0cd515e743411c62e7ef6c1d09e0a6c13ea5b4 Sep 09 23:22:29.108103 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:29.108084 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4608d9a2_3736_484e_b2ea_08b699f70926.slice/crio-92c63a166fb93e6fd91689f9070b505cc0c0a0b0e36f8f9c0fee2ab6cd781694 WatchSource:0}: Error finding container 92c63a166fb93e6fd91689f9070b505cc0c0a0b0e36f8f9c0fee2ab6cd781694: Status 404 returned error can't find the container with id 92c63a166fb93e6fd91689f9070b505cc0c0a0b0e36f8f9c0fee2ab6cd781694 Sep 09 23:22:29.108817 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:29.108783 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ccf608c_06db_4253_bab5_c1ee922617a0.slice/crio-b7b7d57608806192a585fead1394efbfbe8f9d2595e0f26d2abadc468786e7ff WatchSource:0}: Error finding container b7b7d57608806192a585fead1394efbfbe8f9d2595e0f26d2abadc468786e7ff: Status 404 returned error can't find the container with id b7b7d57608806192a585fead1394efbfbe8f9d2595e0f26d2abadc468786e7ff Sep 09 23:22:29.110359 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:22:29.110270 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2357acc3_05fe_4e3b_92a7_7285db060886.slice/crio-cc3fa0eec0c1b5e92a7ec3ecd043da7eb492718573e0f1195be9fe50f33b5af1 WatchSource:0}: Error finding container cc3fa0eec0c1b5e92a7ec3ecd043da7eb492718573e0f1195be9fe50f33b5af1: Status 404 returned error can't find the container with id cc3fa0eec0c1b5e92a7ec3ecd043da7eb492718573e0f1195be9fe50f33b5af1 Sep 09 23:22:29.186740 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.186712 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:29.186844 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.186743 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:29.186844 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:29.186829 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:29.186992 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:29.186965 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:29.205105 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.205078 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" event={"ID":"5094299e-d554-41d2-938d-d5ba8c6559ac","Type":"ContainerStarted","Data":"320154bf32cd1008dfc99f86dcac6f679a2dca4a2134671662d060cd6da89262"} Sep 09 23:22:29.210379 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.210347 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-79.ec2.internal" event={"ID":"b05a491c1df21a93085da4fdaf3acb4e","Type":"ContainerStarted","Data":"09cd3ec4ea7907a618a97fc3df05253fdef258f7db81e7b5446b84ce273d3409"} Sep 09 23:22:29.216319 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.216281 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" event={"ID":"2357acc3-05fe-4e3b-92a7-7285db060886","Type":"ContainerStarted","Data":"cc3fa0eec0c1b5e92a7ec3ecd043da7eb492718573e0f1195be9fe50f33b5af1"} Sep 09 23:22:29.218014 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.217992 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kmnm2" event={"ID":"2ccf608c-06db-4253-bab5-c1ee922617a0","Type":"ContainerStarted","Data":"b7b7d57608806192a585fead1394efbfbe8f9d2595e0f26d2abadc468786e7ff"} Sep 09 23:22:29.219131 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.219111 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" event={"ID":"4608d9a2-3736-484e-b2ea-08b699f70926","Type":"ContainerStarted","Data":"92c63a166fb93e6fd91689f9070b505cc0c0a0b0e36f8f9c0fee2ab6cd781694"} Sep 09 23:22:29.220382 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.220365 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6qqj6" event={"ID":"807e66ae-5942-4115-8fec-ba98c746c881","Type":"ContainerStarted","Data":"5aa468d4309d35571f2c6cd16d0cd515e743411c62e7ef6c1d09e0a6c13ea5b4"} Sep 09 23:22:29.223163 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.223141 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" event={"ID":"7883b927-9bb9-486b-942c-f4174f625009","Type":"ContainerStarted","Data":"6c91ac51554698a9c33db82f8dab9401a9271fd94b9d2762d728c70ed84679d2"} Sep 09 23:22:29.224353 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.224331 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vgg9" event={"ID":"97fc02db-0c12-40dd-b385-ddc20d26adea","Type":"ContainerStarted","Data":"6a4bcbaf7b6beb4a0831fefb5c895f37f27bb3ddd9d06541b9cba08bb3bc37cc"} Sep 09 23:22:29.225814 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.225778 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-79.ec2.internal" podStartSLOduration=2.225766855 podStartE2EDuration="2.225766855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:29.225592414 +0000 UTC m=+3.518322993" watchObservedRunningTime="2026-09-09 23:22:29.225766855 +0000 UTC m=+3.518497420" Sep 09 23:22:29.227951 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.227933 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wgbgm" event={"ID":"c203b67d-ccdf-4ab8-ae1c-e4fa792dd123","Type":"ContainerStarted","Data":"b96366abae26c31a7554242cdd31a20db93a36c7e5869343269dabcf03e42f1b"} Sep 09 23:22:29.229788 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.229772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9rlkq" event={"ID":"e28e30a1-f921-4eca-a164-31765eed74df","Type":"ContainerStarted","Data":"63b630c1434fa0edf52d38f07b5fce6a4463a8ce6823c3e8c0d1e89482fd680b"} Sep 09 23:22:29.671194 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.671116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhz2l\" (UniqueName: \"kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l\") pod \"network-check-target-pvbp9\" (UID: \"d12e593f-3c8d-43b4-91de-74e053cfbf13\") " pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:29.671393 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:29.671338 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:22:29.671393 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:29.671358 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:22:29.671393 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:29.671371 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xhz2l for pod openshift-network-diagnostics/network-check-target-pvbp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:29.671556 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:29.671431 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l podName:d12e593f-3c8d-43b4-91de-74e053cfbf13 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:31.671413594 +0000 UTC m=+5.964144142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhz2l" (UniqueName: "kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l") pod "network-check-target-pvbp9" (UID: "d12e593f-3c8d-43b4-91de-74e053cfbf13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:29.772013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.771968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:29.772190 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:29.772031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:29.772190 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:29.772148 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:29.772346 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:29.772230 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs podName:b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c nodeName:}" failed. No retries permitted until 2026-09-09 23:22:31.772209091 +0000 UTC m=+6.064939649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs") pod "network-metrics-daemon-7cdh4" (UID: "b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:29.772346 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:29.772151 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:29.772346 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:29.772327 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret podName:e0d01aef-6642-4f36-841c-4ffbeecd4d46 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:31.772293139 +0000 UTC m=+6.065023696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret") pod "global-pull-secret-syncer-hkq6b" (UID: "e0d01aef-6642-4f36-841c-4ffbeecd4d46") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:30.087700 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:30.086675 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:17:28 +0000 UTC" deadline="2028-03-16 19:45:19.388869368 +0000 UTC" Sep 09 23:22:30.087700 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:30.086725 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13292h22m49.302146842s" Sep 09 23:22:30.190029 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:30.189980 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:30.190219 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:30.190120 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:30.274076 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:30.273878 2563 generic.go:356] "Generic (PLEG): container finished" podID="801cc8199b4f317b05b6892222bee30b" containerID="4a85e4b618b573f689f1f5d844ac78772d5f412a1dd905b4f17ba4ed086a9f2d" exitCode=0 Sep 09 23:22:30.274899 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:30.274873 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" event={"ID":"801cc8199b4f317b05b6892222bee30b","Type":"ContainerDied","Data":"4a85e4b618b573f689f1f5d844ac78772d5f412a1dd905b4f17ba4ed086a9f2d"} Sep 09 23:22:31.186877 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:31.186839 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:31.187597 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:31.186973 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:31.187597 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:31.187356 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:31.187597 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:31.187457 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:31.285921 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:31.285837 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" event={"ID":"801cc8199b4f317b05b6892222bee30b","Type":"ContainerStarted","Data":"98c13c74787b45141f421de9adf3e9ee6052dcccd5d1259c0c52d870f35f7581"} Sep 09 23:22:31.300968 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:31.300908 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-79.ec2.internal" podStartSLOduration=4.300888307 podStartE2EDuration="4.300888307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:31.30002363 +0000 UTC m=+5.592754195" watchObservedRunningTime="2026-09-09 23:22:31.300888307 +0000 UTC m=+5.593618874" Sep 09 23:22:31.687613 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:31.687518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhz2l\" (UniqueName: \"kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l\") pod \"network-check-target-pvbp9\" (UID: \"d12e593f-3c8d-43b4-91de-74e053cfbf13\") " pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:31.687872 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:31.687853 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:22:31.687958 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:31.687880 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:22:31.687958 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:31.687893 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xhz2l for pod openshift-network-diagnostics/network-check-target-pvbp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:31.687958 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:31.687957 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l podName:d12e593f-3c8d-43b4-91de-74e053cfbf13 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:35.687939365 +0000 UTC m=+9.980669914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhz2l" (UniqueName: "kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l") pod "network-check-target-pvbp9" (UID: "d12e593f-3c8d-43b4-91de-74e053cfbf13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:31.788175 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:31.788134 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:31.788373 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:31.788199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:31.788437 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:31.788377 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:31.788506 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:31.788443 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret podName:e0d01aef-6642-4f36-841c-4ffbeecd4d46 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:35.788423106 +0000 UTC m=+10.081153655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret") pod "global-pull-secret-syncer-hkq6b" (UID: "e0d01aef-6642-4f36-841c-4ffbeecd4d46") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:31.788927 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:31.788832 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:31.788927 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:31.788885 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs podName:b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c nodeName:}" failed. No retries permitted until 2026-09-09 23:22:35.788869771 +0000 UTC m=+10.081600317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs") pod "network-metrics-daemon-7cdh4" (UID: "b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:32.187469 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:32.187366 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:32.187973 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:32.187524 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:33.187668 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:33.187636 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:33.188146 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:33.187760 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:33.188218 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:33.188149 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:33.188271 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:33.188237 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:34.187652 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:34.187524 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:34.187853 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:34.187697 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:35.187743 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:35.187662 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:35.187901 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:35.187662 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:35.187901 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:35.187810 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:35.187901 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:35.187884 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:35.729871 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:35.729824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhz2l\" (UniqueName: \"kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l\") pod \"network-check-target-pvbp9\" (UID: \"d12e593f-3c8d-43b4-91de-74e053cfbf13\") " pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:35.730063 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:35.729982 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:22:35.730063 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:35.730004 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:22:35.730063 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:35.730016 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xhz2l for pod openshift-network-diagnostics/network-check-target-pvbp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:35.730227 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:35.730075 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l podName:d12e593f-3c8d-43b4-91de-74e053cfbf13 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:43.730056339 +0000 UTC m=+18.022786884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhz2l" (UniqueName: "kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l") pod "network-check-target-pvbp9" (UID: "d12e593f-3c8d-43b4-91de-74e053cfbf13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:35.830961 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:35.830916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:35.831130 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:35.830967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:35.831130 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:35.831055 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:35.831130 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:35.831120 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs podName:b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c nodeName:}" failed. No retries permitted until 2026-09-09 23:22:43.831101901 +0000 UTC m=+18.123832461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs") pod "network-metrics-daemon-7cdh4" (UID: "b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:35.831326 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:35.831055 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:35.831398 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:35.831376 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret podName:e0d01aef-6642-4f36-841c-4ffbeecd4d46 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:43.831353201 +0000 UTC m=+18.124083757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret") pod "global-pull-secret-syncer-hkq6b" (UID: "e0d01aef-6642-4f36-841c-4ffbeecd4d46") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:36.187215 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:36.186920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:36.188194 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:36.188154 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:37.188012 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:37.187970 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:37.188182 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:37.188107 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:37.188182 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:37.188139 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:37.188635 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:37.188217 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:38.187399 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:38.187360 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:38.187613 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:38.187516 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:39.187737 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:39.187705 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:39.187737 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:39.187725 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:39.188210 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:39.187825 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:39.188210 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:39.187978 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:40.187222 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:40.187182 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:40.187419 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:40.187343 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:41.186985 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:41.186945 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:41.187471 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:41.187077 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:41.187471 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:41.187135 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:41.187471 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:41.187238 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:42.187224 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:42.187185 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:42.187714 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:42.187331 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:43.187454 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:43.187419 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:43.187957 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:43.187421 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:43.187957 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:43.187559 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:43.187957 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:43.187661 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:43.787825 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:43.787789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhz2l\" (UniqueName: \"kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l\") pod \"network-check-target-pvbp9\" (UID: \"d12e593f-3c8d-43b4-91de-74e053cfbf13\") " pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:43.788010 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:43.787985 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:22:43.788106 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:43.788018 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:22:43.788106 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:43.788032 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xhz2l for pod openshift-network-diagnostics/network-check-target-pvbp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:43.788106 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:43.788093 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l podName:d12e593f-3c8d-43b4-91de-74e053cfbf13 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:59.788074289 +0000 UTC m=+34.080804848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhz2l" (UniqueName: "kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l") pod "network-check-target-pvbp9" (UID: "d12e593f-3c8d-43b4-91de-74e053cfbf13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:43.889117 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:43.889030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:43.889117 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:43.889085 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:43.889364 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:43.889206 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:43.889364 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:43.889220 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:43.889364 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:43.889277 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs podName:b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c nodeName:}" failed. No retries permitted until 2026-09-09 23:22:59.889257642 +0000 UTC m=+34.181988200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs") pod "network-metrics-daemon-7cdh4" (UID: "b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:43.889364 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:43.889339 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret podName:e0d01aef-6642-4f36-841c-4ffbeecd4d46 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:59.889286066 +0000 UTC m=+34.182016609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret") pod "global-pull-secret-syncer-hkq6b" (UID: "e0d01aef-6642-4f36-841c-4ffbeecd4d46") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:44.187223 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:44.187139 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:44.187407 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:44.187261 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:45.187736 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:45.187694 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:45.188194 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:45.187704 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:45.188194 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:45.187817 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:45.188194 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:45.187878 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:46.188292 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:46.188251 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:46.188779 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:46.188397 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:47.188002 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:47.187346 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:47.188002 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:47.187498 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:47.188002 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:47.187879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:47.188002 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:47.187965 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:47.336662 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:47.335899 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" event={"ID":"7883b927-9bb9-486b-942c-f4174f625009","Type":"ContainerStarted","Data":"5e3a42fc1bc73a36f06d2a4ad388ad1ea23c236c6b00bbcd9b5c93a00832e85d"} Sep 09 23:22:47.339533 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:47.339007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vgg9" event={"ID":"97fc02db-0c12-40dd-b385-ddc20d26adea","Type":"ContainerStarted","Data":"ff78fb42b6f85941b40f970e739633fbdc58b312c4df706320d7eef47069a728"} Sep 09 23:22:47.342880 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:47.342760 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wgbgm" event={"ID":"c203b67d-ccdf-4ab8-ae1c-e4fa792dd123","Type":"ContainerStarted","Data":"1047604ec32087e9d9b6a2cc4d28171ec1cdbf22b406e21a07a8f4d6c862e2ab"} Sep 09 23:22:47.344952 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:47.344825 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" event={"ID":"5094299e-d554-41d2-938d-d5ba8c6559ac","Type":"ContainerStarted","Data":"0a99bf773d677a3f0814b70fda5b3587f8973b536b83bd329566401b3df20002"} Sep 09 23:22:47.347018 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:47.346993 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" event={"ID":"2357acc3-05fe-4e3b-92a7-7285db060886","Type":"ContainerStarted","Data":"dafa312ee084c258d1cdd3e81de4e1496037dee4036a7756889874ee23af0348"} Sep 09 23:22:47.353269 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:47.353213 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8jnbm" podStartSLOduration=3.33773915 podStartE2EDuration="21.353201146s" totalImagesPullingTime="18.015461996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:47.35275748 +0000 UTC m=+21.645488066" watchObservedRunningTime="2026-09-09 23:22:47.353201146 +0000 UTC m=+21.645931711" Sep 09 23:22:47.371490 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:47.371273 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5vgg9" podStartSLOduration=3.315713471 podStartE2EDuration="21.371251054s" totalImagesPullingTime="18.055537583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:47.37062617 +0000 UTC m=+21.663356780" watchObservedRunningTime="2026-09-09 23:22:47.371251054 +0000 UTC m=+21.663981620" Sep 09 23:22:47.408550 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:47.408504 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kmnm2" podStartSLOduration=3.418901198 podStartE2EDuration="21.408487684s" totalImagesPullingTime="17.989586486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:47.385822597 +0000 UTC m=+21.678553166" watchObservedRunningTime="2026-09-09 23:22:47.408487684 +0000 UTC m=+21.701218249" Sep 09 23:22:47.425493 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:47.425438 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wgbgm" podStartSLOduration=6.965013713 podStartE2EDuration="21.425420708s" totalImagesPullingTime="14.460406995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:47.425074814 +0000 UTC m=+21.717805382" watchObservedRunningTime="2026-09-09 23:22:47.425420708 +0000 UTC m=+21.718151273" Sep 09 23:22:48.110987 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.110950 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:48.111796 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.111763 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:48.186931 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.186896 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:48.187096 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:48.187029 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:48.354117 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.354079 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" event={"ID":"2357acc3-05fe-4e3b-92a7-7285db060886","Type":"ContainerStarted","Data":"9386beb9814a45504ed80c0e36f3b7bf9f1c31a3f9752bed54be22b01bed3b9d"} Sep 09 23:22:48.354941 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.354189 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" event={"ID":"2357acc3-05fe-4e3b-92a7-7285db060886","Type":"ContainerStarted","Data":"51cdccb90aae99a17ffbac5b6607d7855bc971d1cb045aafefd5eec03900c4ff"} Sep 09 23:22:48.354941 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.354229 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" event={"ID":"2357acc3-05fe-4e3b-92a7-7285db060886","Type":"ContainerStarted","Data":"4d8f01d13daab63340de60404757b9248c0ce3f40f9dc7b717f31ef262cd1f8d"} Sep 09 23:22:48.354941 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.354259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" event={"ID":"2357acc3-05fe-4e3b-92a7-7285db060886","Type":"ContainerStarted","Data":"2d1ef227a59ee7374b848b01d95dda70bb16c049e79acc76d237e91e4cd52f34"} Sep 09 23:22:48.354941 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.354297 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" event={"ID":"2357acc3-05fe-4e3b-92a7-7285db060886","Type":"ContainerStarted","Data":"8cf9375d1c36ff46a610195114f35ad3b693f4482d85a67986e1d682b4f466af"} Sep 09 23:22:48.355762 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.355737 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kmnm2" event={"ID":"2ccf608c-06db-4253-bab5-c1ee922617a0","Type":"ContainerStarted","Data":"5b2453eadbd7399491c1f8cd2b89a0eba48888f499ab42d66e0b0468b3b2f4eb"} Sep 09 23:22:48.357126 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.357107 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" event={"ID":"4608d9a2-3736-484e-b2ea-08b699f70926","Type":"ContainerStarted","Data":"bed50598ab1227d3c10bb0e11c04dab439eb76cfe8e10380556122e93ef33751"} Sep 09 23:22:48.358422 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.358392 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6qqj6" event={"ID":"807e66ae-5942-4115-8fec-ba98c746c881","Type":"ContainerStarted","Data":"0ed837a711f2902cad6955370fbb74f45ca2100529d316af36a6c443334eaeb7"} Sep 09 23:22:48.359779 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.359756 2563 generic.go:356] "Generic (PLEG): container finished" podID="5094299e-d554-41d2-938d-d5ba8c6559ac" containerID="0a99bf773d677a3f0814b70fda5b3587f8973b536b83bd329566401b3df20002" exitCode=0 Sep 09 23:22:48.359888 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.359862 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" event={"ID":"5094299e-d554-41d2-938d-d5ba8c6559ac","Type":"ContainerDied","Data":"0a99bf773d677a3f0814b70fda5b3587f8973b536b83bd329566401b3df20002"} Sep 09 23:22:48.360377 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.360348 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:48.360516 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.360501 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wgbgm" Sep 09 23:22:48.375696 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.375655 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6qqj6" podStartSLOduration=4.384738725 podStartE2EDuration="22.375643667s" totalImagesPullingTime="17.990904942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:48.375573721 +0000 UTC m=+22.668304410" watchObservedRunningTime="2026-09-09 23:22:48.375643667 +0000 UTC m=+22.668374232" Sep 09 23:22:48.614945 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:48.614915 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 23:22:49.108324 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:49.108207 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:22:48.614932857Z","UUID":"51106dc8-217c-4ef3-af87-7a1b059ef0b1","Handler":null,"Name":"","Endpoint":""} Sep 09 23:22:49.109860 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:49.109833 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 23:22:49.109981 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:49.109886 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 23:22:49.187515 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:49.187479 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:49.187515 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:49.187503 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:49.187762 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:49.187618 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:49.187821 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:49.187783 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:49.364993 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:49.364898 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" event={"ID":"4608d9a2-3736-484e-b2ea-08b699f70926","Type":"ContainerStarted","Data":"7ef98a194fe7a1be332456c726a7f2b3fae02ff70358f84af52687a8f81dc82c"} Sep 09 23:22:49.366788 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:49.366748 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9rlkq" event={"ID":"e28e30a1-f921-4eca-a164-31765eed74df","Type":"ContainerStarted","Data":"9dc2a2fa1bd94ccbbf205f80410ed8f7b76d4fc6e03eb209f8fc85438e186620"} Sep 09 23:22:49.383110 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:49.383054 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9rlkq" podStartSLOduration=5.387867782 podStartE2EDuration="23.383032089s" totalImagesPullingTime="17.995164307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:49.382569 +0000 UTC m=+23.675299587" watchObservedRunningTime="2026-09-09 23:22:49.383032089 +0000 UTC m=+23.675762657" Sep 09 23:22:50.187608 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:50.187576 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:50.187788 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:50.187720 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:50.372666 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:50.372625 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" event={"ID":"2357acc3-05fe-4e3b-92a7-7285db060886","Type":"ContainerStarted","Data":"babc265436c6fcb32984c89b0965c2c9c0fda85a3970f97536d6c785f0f8db20"} Sep 09 23:22:50.375177 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:50.375144 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" event={"ID":"4608d9a2-3736-484e-b2ea-08b699f70926","Type":"ContainerStarted","Data":"b054567df3fcacf926150e63e6f6e344046aa992240648de6d1144e49a3fe916"} Sep 09 23:22:50.393722 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:50.393663 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvfrs" podStartSLOduration=4.148505961 podStartE2EDuration="24.3936422s" totalImagesPullingTime="20.245136239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:50.393597266 +0000 UTC m=+24.686327854" watchObservedRunningTime="2026-09-09 23:22:50.3936422 +0000 UTC m=+24.686372747" Sep 09 23:22:51.187056 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:51.187020 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:51.187275 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:51.187020 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:51.187275 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:51.187138 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:51.187275 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:51.187243 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:52.187123 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:52.187042 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:52.187564 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:52.187186 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:53.187900 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:53.187661 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:53.188588 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:53.187695 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:53.188588 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:53.187963 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:53.188588 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:53.188024 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:53.383349 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:53.383296 2563 generic.go:356] "Generic (PLEG): container finished" podID="5094299e-d554-41d2-938d-d5ba8c6559ac" containerID="7af2cdfcf379e9a43e354adca8adde4ed21fb47d1c3eb7d1f4cf90ffa08cb1ed" exitCode=0 Sep 09 23:22:53.383349 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:53.383338 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" event={"ID":"5094299e-d554-41d2-938d-d5ba8c6559ac","Type":"ContainerDied","Data":"7af2cdfcf379e9a43e354adca8adde4ed21fb47d1c3eb7d1f4cf90ffa08cb1ed"} Sep 09 23:22:53.392561 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:53.392537 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" event={"ID":"2357acc3-05fe-4e3b-92a7-7285db060886","Type":"ContainerStarted","Data":"1ceb4b05b0846918393846bc1c7eed7cc3cb6936e66956d35089266fe8e602c1"} Sep 09 23:22:53.392801 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:53.392778 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:53.392922 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:53.392853 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:53.410654 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:53.410615 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:53.436611 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:53.436564 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" podStartSLOduration=9.393063679 podStartE2EDuration="27.436552874s" totalImagesPullingTime="18.043489195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:53.436156415 +0000 UTC m=+27.728886980" watchObservedRunningTime="2026-09-09 23:22:53.436552874 +0000 UTC m=+27.729283439" Sep 09 23:22:53.534086 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:53.534002 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6qqj6_807e66ae-5942-4115-8fec-ba98c746c881/dns-node-resolver/0.log" Sep 09 23:22:54.186993 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:54.186964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:54.187134 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:54.187075 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:54.307720 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:54.307683 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kmnm2_2ccf608c-06db-4253-bab5-c1ee922617a0/node-ca/0.log" Sep 09 23:22:54.395646 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:54.395610 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:54.413832 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:54.413632 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:22:54.596673 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:54.596631 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pvbp9"] Sep 09 23:22:54.596869 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:54.596783 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:54.596920 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:54.596894 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:54.597372 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:54.597348 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7cdh4"] Sep 09 23:22:54.597481 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:54.597446 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:54.597573 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:54.597555 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:54.597925 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:54.597906 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hkq6b"] Sep 09 23:22:54.598005 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:54.597994 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:54.598089 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:54.598072 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:55.399034 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:55.398989 2563 generic.go:356] "Generic (PLEG): container finished" podID="5094299e-d554-41d2-938d-d5ba8c6559ac" containerID="b88bebcbe8bbf3be296da3c63f4e460c7aac2a27b739e6bc8a76060ffd771648" exitCode=0 Sep 09 23:22:55.399445 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:55.399054 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" event={"ID":"5094299e-d554-41d2-938d-d5ba8c6559ac","Type":"ContainerDied","Data":"b88bebcbe8bbf3be296da3c63f4e460c7aac2a27b739e6bc8a76060ffd771648"} Sep 09 23:22:56.188174 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:56.188141 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:56.188360 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:56.188229 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:56.188360 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:56.188276 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:56.188432 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:56.188354 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:56.188432 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:56.188382 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:56.188496 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:56.188460 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:57.405496 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:57.405460 2563 generic.go:356] "Generic (PLEG): container finished" podID="5094299e-d554-41d2-938d-d5ba8c6559ac" containerID="a2c66ec087e23a49220035f7bca1860bf6e753b605c32f01b48eb1d725e94162" exitCode=0 Sep 09 23:22:57.405848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:57.405523 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" event={"ID":"5094299e-d554-41d2-938d-d5ba8c6559ac","Type":"ContainerDied","Data":"a2c66ec087e23a49220035f7bca1860bf6e753b605c32f01b48eb1d725e94162"} Sep 09 23:22:58.187441 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:58.187399 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:58.187649 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:58.187439 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:58.187649 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:58.187533 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:58.187649 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:58.187562 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:22:58.187649 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:58.187634 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:22:58.187832 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:58.187726 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:22:59.805950 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:59.805915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhz2l\" (UniqueName: \"kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l\") pod \"network-check-target-pvbp9\" (UID: \"d12e593f-3c8d-43b4-91de-74e053cfbf13\") " pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:22:59.806603 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:59.806049 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:22:59.806603 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:59.806067 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:22:59.806603 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:59.806080 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xhz2l for pod openshift-network-diagnostics/network-check-target-pvbp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:59.806603 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:59.806139 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l podName:d12e593f-3c8d-43b4-91de-74e053cfbf13 nodeName:}" failed. No retries permitted until 2026-09-09 23:23:31.806121704 +0000 UTC m=+66.098852248 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhz2l" (UniqueName: "kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l") pod "network-check-target-pvbp9" (UID: "d12e593f-3c8d-43b4-91de-74e053cfbf13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:22:59.907076 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:59.907038 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:22:59.907076 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:22:59.907079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:22:59.907273 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:59.907192 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:59.907273 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:59.907225 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:22:59.907273 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:59.907250 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret podName:e0d01aef-6642-4f36-841c-4ffbeecd4d46 nodeName:}" failed. No retries permitted until 2026-09-09 23:23:31.907233277 +0000 UTC m=+66.199963834 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret") pod "global-pull-secret-syncer-hkq6b" (UID: "e0d01aef-6642-4f36-841c-4ffbeecd4d46") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:22:59.907401 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:22:59.907294 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs podName:b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c nodeName:}" failed. No retries permitted until 2026-09-09 23:23:31.907273877 +0000 UTC m=+66.200004428 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs") pod "network-metrics-daemon-7cdh4" (UID: "b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:23:00.187391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:00.187171 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:00.187586 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:00.187170 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:00.187586 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:00.187495 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:23:00.187586 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:00.187223 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:00.187586 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:00.187566 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:23:00.187814 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:00.187623 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:23:02.187162 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:02.187131 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:02.187649 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:02.187130 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:02.187649 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:02.187237 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:23:02.187649 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:02.187258 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:02.187649 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:02.187381 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:23:02.187649 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:02.187435 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:23:02.420924 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:02.420890 2563 generic.go:356] "Generic (PLEG): container finished" podID="5094299e-d554-41d2-938d-d5ba8c6559ac" containerID="29e26400fb47c172b7f4fdd56578beb1a2c77fe9e392f89b7ac0d295952333a0" exitCode=0 Sep 09 23:23:02.421080 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:02.420959 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" event={"ID":"5094299e-d554-41d2-938d-d5ba8c6559ac","Type":"ContainerDied","Data":"29e26400fb47c172b7f4fdd56578beb1a2c77fe9e392f89b7ac0d295952333a0"} Sep 09 23:23:03.426474 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:03.426440 2563 generic.go:356] "Generic (PLEG): container finished" podID="5094299e-d554-41d2-938d-d5ba8c6559ac" containerID="c207c047983b79e65083176c6e49892942eb940fe677b7fc1c33def7dc871afe" exitCode=0 Sep 09 23:23:03.426939 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:03.426509 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" event={"ID":"5094299e-d554-41d2-938d-d5ba8c6559ac","Type":"ContainerDied","Data":"c207c047983b79e65083176c6e49892942eb940fe677b7fc1c33def7dc871afe"} Sep 09 23:23:04.187119 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:04.187091 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:04.187264 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:04.187104 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:04.187264 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:04.187205 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:23:04.187361 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:04.187296 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:23:04.187404 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:04.187389 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:04.187481 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:04.187464 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:23:04.434919 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:04.434880 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" event={"ID":"5094299e-d554-41d2-938d-d5ba8c6559ac","Type":"ContainerStarted","Data":"d89d0119ed34540e96eb4a57609686d2b7e7dc84f1ff15c0fd7f38d459810538"} Sep 09 23:23:04.456024 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:04.455969 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fpqb4" podStartSLOduration=9.892019031 podStartE2EDuration="38.455951208s" totalImagesPullingTime="28.563932177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:04.453968964 +0000 UTC m=+38.746699529" watchObservedRunningTime="2026-09-09 23:23:04.455951208 +0000 UTC m=+38.748681774" Sep 09 23:23:06.187967 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:06.187926 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:06.188325 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:06.188019 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:23:06.188325 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:06.188029 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:06.188325 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:06.188055 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:06.188325 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:06.188131 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:23:06.188325 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:06.188192 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:23:08.187440 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:08.187408 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:08.187440 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:08.187429 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:08.187858 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:08.187429 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:08.187858 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:08.187514 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:23:08.187858 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:08.187595 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:23:08.187858 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:08.187648 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:23:10.187255 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:10.187220 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:10.187255 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:10.187254 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:10.187753 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:10.187229 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:10.187753 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:10.187338 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:23:10.187753 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:10.187399 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:23:10.187753 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:10.187516 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:23:12.187743 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:12.187708 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:12.187743 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:12.187731 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:12.188154 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:12.187710 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:12.188154 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:12.187837 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:23:12.188154 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:12.187891 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:23:12.188154 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:12.187944 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:23:14.186843 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:14.186809 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:14.187297 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:14.186809 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:14.187297 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:14.186933 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pvbp9" podUID="d12e593f-3c8d-43b4-91de-74e053cfbf13" Sep 09 23:23:14.187297 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:14.186943 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:14.187297 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:14.187015 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkq6b" podUID="e0d01aef-6642-4f36-841c-4ffbeecd4d46" Sep 09 23:23:14.187297 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:14.187090 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cdh4" podUID="b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c" Sep 09 23:23:15.995743 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:15.995668 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-79.ec2.internal" event="NodeReady" Sep 09 23:23:15.996125 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:15.995799 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 23:23:16.039254 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.039217 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c9898c6f4-qxcsd"] Sep 09 23:23:16.059602 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.059570 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9898c6f4-qxcsd"] Sep 09 23:23:16.059751 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.059667 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.062328 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.062281 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rbxzx"] Sep 09 23:23:16.062784 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.062761 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2fk9d\"" Sep 09 23:23:16.062892 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.062761 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 23:23:16.063902 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.063879 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 23:23:16.064397 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.064379 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 23:23:16.078074 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.078027 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2wczt"] Sep 09 23:23:16.078225 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.078207 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.078981 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.078957 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 23:23:16.087949 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.087928 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 23:23:16.088025 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.087953 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 23:23:16.088081 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.088017 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 23:23:16.088358 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.088342 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vzwm7\"" Sep 09 23:23:16.090319 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.090287 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 23:23:16.105373 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.105350 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rbxzx"] Sep 09 23:23:16.105479 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.105388 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2wczt"] Sep 09 23:23:16.105479 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.105471 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.108443 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.108423 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 23:23:16.108569 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.108501 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c92sf\"" Sep 09 23:23:16.108569 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.108505 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 23:23:16.164593 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.164557 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f4xtd"] Sep 09 23:23:16.181292 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.181258 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f4xtd"] Sep 09 23:23:16.181480 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.181381 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f4xtd" Sep 09 23:23:16.184487 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.184464 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 23:23:16.184607 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.184540 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 23:23:16.184730 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.184713 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 23:23:16.184730 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.184724 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jdkjc\"" Sep 09 23:23:16.186848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.186826 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:16.186848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.186837 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:16.187037 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.186919 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:16.189950 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.189929 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:23:16.190048 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.190005 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:23:16.190298 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.190280 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8xjv6\"" Sep 09 23:23:16.190402 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.190339 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:23:16.190402 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.190383 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xzm9\"" Sep 09 23:23:16.190507 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.190452 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:23:16.214332 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7qtn\" (UniqueName: \"kubernetes.io/projected/4b0958fe-427f-436e-9e5e-34b5281ae880-kube-api-access-p7qtn\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.214440 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214343 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5x4n\" (UniqueName: \"kubernetes.io/projected/4ab3e715-dcbf-4db3-8b76-549541573136-kube-api-access-w5x4n\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.214440 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86248d06-6829-4b8d-8e18-72fda053ad41-tmp-dir\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.214440 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ab3e715-dcbf-4db3-8b76-549541573136-installation-pull-secrets\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.214440 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ab3e715-dcbf-4db3-8b76-549541573136-bound-sa-token\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.214440 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214417 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/86248d06-6829-4b8d-8e18-72fda053ad41-config-volume\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.214612 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf6sr\" (UniqueName: \"kubernetes.io/projected/86248d06-6829-4b8d-8e18-72fda053ad41-kube-api-access-nf6sr\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.214612 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ab3e715-dcbf-4db3-8b76-549541573136-image-registry-private-configuration\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.214612 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b0958fe-427f-436e-9e5e-34b5281ae880-data-volume\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.214612 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214517 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b0958fe-427f-436e-9e5e-34b5281ae880-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.214612 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b0958fe-427f-436e-9e5e-34b5281ae880-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.214612 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ab3e715-dcbf-4db3-8b76-549541573136-registry-tls\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.214784 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ab3e715-dcbf-4db3-8b76-549541573136-trusted-ca\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.214784 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/86248d06-6829-4b8d-8e18-72fda053ad41-metrics-tls\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.214784 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214667 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ab3e715-dcbf-4db3-8b76-549541573136-registry-certificates\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.214784 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214683 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b0958fe-427f-436e-9e5e-34b5281ae880-crio-socket\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.214784 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.214721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ab3e715-dcbf-4db3-8b76-549541573136-ca-trust-extracted\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.315735 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.315644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5x4n\" (UniqueName: \"kubernetes.io/projected/4ab3e715-dcbf-4db3-8b76-549541573136-kube-api-access-w5x4n\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.315735 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.315684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86248d06-6829-4b8d-8e18-72fda053ad41-tmp-dir\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.315735 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.315716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ab3e715-dcbf-4db3-8b76-549541573136-installation-pull-secrets\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.315994 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.315741 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ab3e715-dcbf-4db3-8b76-549541573136-bound-sa-token\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.315994 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.315858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/86248d06-6829-4b8d-8e18-72fda053ad41-config-volume\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.315994 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.315919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf6sr\" (UniqueName: \"kubernetes.io/projected/86248d06-6829-4b8d-8e18-72fda053ad41-kube-api-access-nf6sr\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.315994 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.315947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ab3e715-dcbf-4db3-8b76-549541573136-image-registry-private-configuration\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.315994 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.315966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b0958fe-427f-436e-9e5e-34b5281ae880-data-volume\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.315994 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.315990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b0958fe-427f-436e-9e5e-34b5281ae880-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.316228 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316048 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86248d06-6829-4b8d-8e18-72fda053ad41-tmp-dir\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.316228 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316089 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b0958fe-427f-436e-9e5e-34b5281ae880-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.316228 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316134 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ab3e715-dcbf-4db3-8b76-549541573136-registry-tls\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.316228 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ab3e715-dcbf-4db3-8b76-549541573136-trusted-ca\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.316228 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/86248d06-6829-4b8d-8e18-72fda053ad41-metrics-tls\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.316228 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ab3e715-dcbf-4db3-8b76-549541573136-registry-certificates\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.316524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b0958fe-427f-436e-9e5e-34b5281ae880-crio-socket\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.316524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ab3e715-dcbf-4db3-8b76-549541573136-ca-trust-extracted\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.316524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316331 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7814455e-89ca-49a3-ba29-f6048db57aef-cert\") pod \"ingress-canary-f4xtd\" (UID: \"7814455e-89ca-49a3-ba29-f6048db57aef\") " pod="openshift-ingress-canary/ingress-canary-f4xtd" Sep 09 23:23:16.316524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mms5s\" (UniqueName: \"kubernetes.io/projected/7814455e-89ca-49a3-ba29-f6048db57aef-kube-api-access-mms5s\") pod \"ingress-canary-f4xtd\" (UID: \"7814455e-89ca-49a3-ba29-f6048db57aef\") " pod="openshift-ingress-canary/ingress-canary-f4xtd" Sep 09 23:23:16.316524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316387 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b0958fe-427f-436e-9e5e-34b5281ae880-data-volume\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.316524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316469 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/86248d06-6829-4b8d-8e18-72fda053ad41-config-volume\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.316524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7qtn\" (UniqueName: \"kubernetes.io/projected/4b0958fe-427f-436e-9e5e-34b5281ae880-kube-api-access-p7qtn\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.317188 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316555 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b0958fe-427f-436e-9e5e-34b5281ae880-crio-socket\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.317188 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.316827 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b0958fe-427f-436e-9e5e-34b5281ae880-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.317541 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.317519 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ab3e715-dcbf-4db3-8b76-549541573136-registry-certificates\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.317675 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.317550 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ab3e715-dcbf-4db3-8b76-549541573136-ca-trust-extracted\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.317770 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.317678 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ab3e715-dcbf-4db3-8b76-549541573136-trusted-ca\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.320180 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.320152 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ab3e715-dcbf-4db3-8b76-549541573136-registry-tls\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.320279 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.320259 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/86248d06-6829-4b8d-8e18-72fda053ad41-metrics-tls\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.320370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.320346 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b0958fe-427f-436e-9e5e-34b5281ae880-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.320370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.320364 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ab3e715-dcbf-4db3-8b76-549541573136-installation-pull-secrets\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.320667 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.320648 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ab3e715-dcbf-4db3-8b76-549541573136-image-registry-private-configuration\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.323874 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.323854 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5x4n\" (UniqueName: \"kubernetes.io/projected/4ab3e715-dcbf-4db3-8b76-549541573136-kube-api-access-w5x4n\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.324000 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.323975 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ab3e715-dcbf-4db3-8b76-549541573136-bound-sa-token\") pod \"image-registry-c9898c6f4-qxcsd\" (UID: \"4ab3e715-dcbf-4db3-8b76-549541573136\") " pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.324097 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.324071 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7qtn\" (UniqueName: \"kubernetes.io/projected/4b0958fe-427f-436e-9e5e-34b5281ae880-kube-api-access-p7qtn\") pod \"insights-runtime-extractor-rbxzx\" (UID: \"4b0958fe-427f-436e-9e5e-34b5281ae880\") " pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.325789 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.325772 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf6sr\" (UniqueName: \"kubernetes.io/projected/86248d06-6829-4b8d-8e18-72fda053ad41-kube-api-access-nf6sr\") pod \"dns-default-2wczt\" (UID: \"86248d06-6829-4b8d-8e18-72fda053ad41\") " pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.370362 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.370326 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:16.386496 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.386463 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rbxzx" Sep 09 23:23:16.415530 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.415505 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:16.417772 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.417750 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7814455e-89ca-49a3-ba29-f6048db57aef-cert\") pod \"ingress-canary-f4xtd\" (UID: \"7814455e-89ca-49a3-ba29-f6048db57aef\") " pod="openshift-ingress-canary/ingress-canary-f4xtd" Sep 09 23:23:16.417830 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.417780 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mms5s\" (UniqueName: \"kubernetes.io/projected/7814455e-89ca-49a3-ba29-f6048db57aef-kube-api-access-mms5s\") pod \"ingress-canary-f4xtd\" (UID: \"7814455e-89ca-49a3-ba29-f6048db57aef\") " pod="openshift-ingress-canary/ingress-canary-f4xtd" Sep 09 23:23:16.420106 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.420086 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7814455e-89ca-49a3-ba29-f6048db57aef-cert\") pod \"ingress-canary-f4xtd\" (UID: \"7814455e-89ca-49a3-ba29-f6048db57aef\") " pod="openshift-ingress-canary/ingress-canary-f4xtd" Sep 09 23:23:16.437161 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.437128 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mms5s\" (UniqueName: \"kubernetes.io/projected/7814455e-89ca-49a3-ba29-f6048db57aef-kube-api-access-mms5s\") pod \"ingress-canary-f4xtd\" (UID: \"7814455e-89ca-49a3-ba29-f6048db57aef\") " pod="openshift-ingress-canary/ingress-canary-f4xtd" Sep 09 23:23:16.490889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.490844 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f4xtd" Sep 09 23:23:16.701065 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.701032 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rbxzx"] Sep 09 23:23:16.704678 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:16.704534 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0958fe_427f_436e_9e5e_34b5281ae880.slice/crio-276afb02cfb731891f11705e778594074288d732a7770f3001c0203bffd6f882 WatchSource:0}: Error finding container 276afb02cfb731891f11705e778594074288d732a7770f3001c0203bffd6f882: Status 404 returned error can't find the container with id 276afb02cfb731891f11705e778594074288d732a7770f3001c0203bffd6f882 Sep 09 23:23:16.705374 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.705338 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9898c6f4-qxcsd"] Sep 09 23:23:16.709897 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:16.709875 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab3e715_dcbf_4db3_8b76_549541573136.slice/crio-3d5c8585dc24781866b94a6ff66a2388d85325440b9b196bcd17a6594dc9b3ce WatchSource:0}: Error finding container 3d5c8585dc24781866b94a6ff66a2388d85325440b9b196bcd17a6594dc9b3ce: Status 404 returned error can't find the container with id 3d5c8585dc24781866b94a6ff66a2388d85325440b9b196bcd17a6594dc9b3ce Sep 09 23:23:16.736618 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.736590 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2wczt"] Sep 09 23:23:16.747287 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:16.747259 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86248d06_6829_4b8d_8e18_72fda053ad41.slice/crio-96f62a504174b80dfa6dacf4085a0df3f0fa7b45cbe1ed1931837aa85607ff53 WatchSource:0}: Error finding container 96f62a504174b80dfa6dacf4085a0df3f0fa7b45cbe1ed1931837aa85607ff53: Status 404 returned error can't find the container with id 96f62a504174b80dfa6dacf4085a0df3f0fa7b45cbe1ed1931837aa85607ff53 Sep 09 23:23:16.787902 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:16.787878 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f4xtd"] Sep 09 23:23:16.792232 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:16.792204 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7814455e_89ca_49a3_ba29_f6048db57aef.slice/crio-6db6a8addb63bbaba181e6f6c426f2602d33e160ffcc8faa924eb9d71f581d79 WatchSource:0}: Error finding container 6db6a8addb63bbaba181e6f6c426f2602d33e160ffcc8faa924eb9d71f581d79: Status 404 returned error can't find the container with id 6db6a8addb63bbaba181e6f6c426f2602d33e160ffcc8faa924eb9d71f581d79 Sep 09 23:23:17.465256 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:17.465214 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wczt" event={"ID":"86248d06-6829-4b8d-8e18-72fda053ad41","Type":"ContainerStarted","Data":"96f62a504174b80dfa6dacf4085a0df3f0fa7b45cbe1ed1931837aa85607ff53"} Sep 09 23:23:17.467940 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:17.467720 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbxzx" event={"ID":"4b0958fe-427f-436e-9e5e-34b5281ae880","Type":"ContainerStarted","Data":"9d2f4eae5eff62fe16b2b5ee836f319bbfeede4fc24794a5700c69a6ff7b04ed"} Sep 09 23:23:17.467940 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:17.467853 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbxzx" event={"ID":"4b0958fe-427f-436e-9e5e-34b5281ae880","Type":"ContainerStarted","Data":"276afb02cfb731891f11705e778594074288d732a7770f3001c0203bffd6f882"} Sep 09 23:23:17.469933 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:17.469872 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f4xtd" event={"ID":"7814455e-89ca-49a3-ba29-f6048db57aef","Type":"ContainerStarted","Data":"6db6a8addb63bbaba181e6f6c426f2602d33e160ffcc8faa924eb9d71f581d79"} Sep 09 23:23:17.472530 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:17.472463 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" event={"ID":"4ab3e715-dcbf-4db3-8b76-549541573136","Type":"ContainerStarted","Data":"61975ce48786401844cdaccc7e55f72d402f02c8b4f7cebbdbe5b603ad18c2a1"} Sep 09 23:23:17.472530 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:17.472496 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" event={"ID":"4ab3e715-dcbf-4db3-8b76-549541573136","Type":"ContainerStarted","Data":"3d5c8585dc24781866b94a6ff66a2388d85325440b9b196bcd17a6594dc9b3ce"} Sep 09 23:23:17.472674 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:17.472604 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:17.500382 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:17.500318 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" podStartSLOduration=2.50028309 podStartE2EDuration="2.50028309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:17.498438919 +0000 UTC m=+51.791169510" watchObservedRunningTime="2026-09-09 23:23:17.50028309 +0000 UTC m=+51.793013656" Sep 09 23:23:18.477110 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:18.477067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbxzx" event={"ID":"4b0958fe-427f-436e-9e5e-34b5281ae880","Type":"ContainerStarted","Data":"542fc1968ad6bc20da4d5dbf45bf005cabb49331ba0a6fc76e7ee2486c7f218b"} Sep 09 23:23:19.481858 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:19.481813 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wczt" event={"ID":"86248d06-6829-4b8d-8e18-72fda053ad41","Type":"ContainerStarted","Data":"3c53064364d8d9062455703a9367f90c9086daf4898855fd8b382f3b62dfae3e"} Sep 09 23:23:20.487158 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:20.487112 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wczt" event={"ID":"86248d06-6829-4b8d-8e18-72fda053ad41","Type":"ContainerStarted","Data":"dac63339d2f1666074936566ee53332f0829ea47c8ce890c773227697abf641a"} Sep 09 23:23:20.487642 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:20.487228 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:20.489252 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:20.489229 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbxzx" event={"ID":"4b0958fe-427f-436e-9e5e-34b5281ae880","Type":"ContainerStarted","Data":"a677e462b028e0535beb2ea252bbda28203d3e9620929a3039382f8b32eca334"} Sep 09 23:23:20.490662 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:20.490638 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f4xtd" event={"ID":"7814455e-89ca-49a3-ba29-f6048db57aef","Type":"ContainerStarted","Data":"e705f285932304c16f299f5267fbfbf626490832e09b300c4a958acec804b172"} Sep 09 23:23:20.507343 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:20.507263 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2wczt" podStartSLOduration=2.712741758 podStartE2EDuration="4.507250123s" totalImagesPullingTime="1.794508365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:20.505917901 +0000 UTC m=+54.798648491" watchObservedRunningTime="2026-09-09 23:23:20.507250123 +0000 UTC m=+54.799980682" Sep 09 23:23:20.526869 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:20.526821 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rbxzx" podStartSLOduration=1.725431282 podStartE2EDuration="4.52680833s" totalImagesPullingTime="2.801377048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:23:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:20.526460177 +0000 UTC m=+54.819190763" watchObservedRunningTime="2026-09-09 23:23:20.52680833 +0000 UTC m=+54.819538894" Sep 09 23:23:20.545359 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:20.545277 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f4xtd" podStartSLOduration=1.581554389 podStartE2EDuration="4.545258134s" totalImagesPullingTime="2.963703745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:20.544759282 +0000 UTC m=+54.837489848" watchObservedRunningTime="2026-09-09 23:23:20.545258134 +0000 UTC m=+54.837988699" Sep 09 23:23:26.411627 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:26.411593 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2rnn" Sep 09 23:23:27.713691 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.713652 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm"] Sep 09 23:23:27.716594 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.716577 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.718906 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.718883 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 09 23:23:27.719010 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.718890 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 09 23:23:27.719795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.719770 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 23:23:27.719908 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.719870 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lsfjg\"" Sep 09 23:23:27.719908 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.719888 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 23:23:27.720006 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.719909 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 23:23:27.734086 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.734059 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm"] Sep 09 23:23:27.755284 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.755256 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7qk78"] Sep 09 23:23:27.757077 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.757063 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.759491 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.759462 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 23:23:27.759491 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.759476 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 23:23:27.759654 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.759515 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-89p5w\"" Sep 09 23:23:27.759654 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.759576 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 23:23:27.801669 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.801636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c81a81f3-158b-4299-8ac9-561a08af5644-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.801811 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.801675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-textfile\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.801811 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.801697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.801811 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.801791 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.801927 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.801827 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-wtmp\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.801927 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.801855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vfgp\" (UniqueName: \"kubernetes.io/projected/28391c32-56a2-44d7-8629-5aa7dc4a38cb-kube-api-access-7vfgp\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.801927 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.801888 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28391c32-56a2-44d7-8629-5aa7dc4a38cb-root\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.802015 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.801928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c81a81f3-158b-4299-8ac9-561a08af5644-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.802015 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.801956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c81a81f3-158b-4299-8ac9-561a08af5644-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.802015 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.801971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28391c32-56a2-44d7-8629-5aa7dc4a38cb-sys\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.802015 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.801987 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk5jz\" (UniqueName: \"kubernetes.io/projected/c81a81f3-158b-4299-8ac9-561a08af5644-kube-api-access-dk5jz\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.802015 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.802004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-tls\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.802155 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.802040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28391c32-56a2-44d7-8629-5aa7dc4a38cb-metrics-client-ca\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.902551 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vfgp\" (UniqueName: \"kubernetes.io/projected/28391c32-56a2-44d7-8629-5aa7dc4a38cb-kube-api-access-7vfgp\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.902551 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28391c32-56a2-44d7-8629-5aa7dc4a38cb-root\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.902742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c81a81f3-158b-4299-8ac9-561a08af5644-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.902742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c81a81f3-158b-4299-8ac9-561a08af5644-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.902742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28391c32-56a2-44d7-8629-5aa7dc4a38cb-sys\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.902742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902644 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28391c32-56a2-44d7-8629-5aa7dc4a38cb-root\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.902742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk5jz\" (UniqueName: \"kubernetes.io/projected/c81a81f3-158b-4299-8ac9-561a08af5644-kube-api-access-dk5jz\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.902742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-tls\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.902742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28391c32-56a2-44d7-8629-5aa7dc4a38cb-metrics-client-ca\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.903051 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902745 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28391c32-56a2-44d7-8629-5aa7dc4a38cb-sys\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.903051 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902754 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c81a81f3-158b-4299-8ac9-561a08af5644-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.903051 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902809 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-textfile\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.903051 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:27.902823 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 09 23:23:27.903051 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.903051 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:27.902879 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c81a81f3-158b-4299-8ac9-561a08af5644-openshift-state-metrics-tls podName:c81a81f3-158b-4299-8ac9-561a08af5644 nodeName:}" failed. No retries permitted until 2026-09-09 23:23:28.402861354 +0000 UTC m=+62.695591916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c81a81f3-158b-4299-8ac9-561a08af5644-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-rmljm" (UID: "c81a81f3-158b-4299-8ac9-561a08af5644") : secret "openshift-state-metrics-tls" not found Sep 09 23:23:27.903051 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.902973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.903051 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.903032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-wtmp\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.903519 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.903197 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-wtmp\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.903519 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.903433 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-textfile\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.903624 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.903567 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28391c32-56a2-44d7-8629-5aa7dc4a38cb-metrics-client-ca\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.903675 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.903638 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.903729 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.903676 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c81a81f3-158b-4299-8ac9-561a08af5644-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.905196 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.905164 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-tls\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.905355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.905240 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c81a81f3-158b-4299-8ac9-561a08af5644-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.905355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.905342 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28391c32-56a2-44d7-8629-5aa7dc4a38cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:27.913153 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.913128 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk5jz\" (UniqueName: \"kubernetes.io/projected/c81a81f3-158b-4299-8ac9-561a08af5644-kube-api-access-dk5jz\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:27.913245 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:27.913181 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vfgp\" (UniqueName: \"kubernetes.io/projected/28391c32-56a2-44d7-8629-5aa7dc4a38cb-kube-api-access-7vfgp\") pod \"node-exporter-7qk78\" (UID: \"28391c32-56a2-44d7-8629-5aa7dc4a38cb\") " pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:28.066257 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.066177 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7qk78" Sep 09 23:23:28.076735 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:28.076702 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28391c32_56a2_44d7_8629_5aa7dc4a38cb.slice/crio-cf25e610065d53af80ac8f9b3cdae4355af966a29541163d823c74ebf4ea147d WatchSource:0}: Error finding container cf25e610065d53af80ac8f9b3cdae4355af966a29541163d823c74ebf4ea147d: Status 404 returned error can't find the container with id cf25e610065d53af80ac8f9b3cdae4355af966a29541163d823c74ebf4ea147d Sep 09 23:23:28.407180 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.407146 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c81a81f3-158b-4299-8ac9-561a08af5644-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:28.409616 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.409580 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c81a81f3-158b-4299-8ac9-561a08af5644-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-rmljm\" (UID: \"c81a81f3-158b-4299-8ac9-561a08af5644\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:28.518029 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.517994 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qk78" event={"ID":"28391c32-56a2-44d7-8629-5aa7dc4a38cb","Type":"ContainerStarted","Data":"cf25e610065d53af80ac8f9b3cdae4355af966a29541163d823c74ebf4ea147d"} Sep 09 23:23:28.625731 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.625690 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" Sep 09 23:23:28.772105 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.772051 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:23:28.775407 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.775382 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.777730 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.777703 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 23:23:28.777880 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.777831 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 23:23:28.777880 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.777866 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 23:23:28.778031 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.777831 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 23:23:28.778031 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.777976 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 23:23:28.778172 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.778069 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 23:23:28.778172 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.778083 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 23:23:28.778172 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.778157 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 23:23:28.778330 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.778202 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 23:23:28.778330 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.778225 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jnbp4\"" Sep 09 23:23:28.788272 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.788253 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:23:28.817094 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817055 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.817094 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.817368 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.817368 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.817368 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-out\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.817655 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.817725 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.817781 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.817833 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcnj6\" (UniqueName: \"kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-kube-api-access-mcnj6\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.817885 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.817939 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.817972 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.817949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.821109 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.818072 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-web-config\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.902524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.902494 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm"] Sep 09 23:23:28.919401 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.919569 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.919569 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.919569 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-web-config\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.919569 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919538 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.919569 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.919809 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.919809 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919629 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.919809 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:28.919666 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-trusted-ca-bundle podName:e3dd9a70-52bb-43c7-afb8-0d32e26a2f81 nodeName:}" failed. No retries permitted until 2026-09-09 23:23:29.41964103 +0000 UTC m=+63.712371589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81") : configmap references non-existent config key: ca-bundle.crt Sep 09 23:23:28.919809 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:28.919704 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 09 23:23:28.919809 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-out\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.919809 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:23:28.919748 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-main-tls podName:e3dd9a70-52bb-43c7-afb8-0d32e26a2f81 nodeName:}" failed. No retries permitted until 2026-09-09 23:23:29.419736978 +0000 UTC m=+63.712467526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81") : secret "alertmanager-main-tls" not found Sep 09 23:23:28.919809 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919779 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.920143 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.920143 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919871 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.920143 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.919924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcnj6\" (UniqueName: \"kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-kube-api-access-mcnj6\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.920143 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.920011 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.920357 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.920235 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.922711 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.922681 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.923214 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.923187 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.923340 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.923234 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.923528 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.923507 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-out\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.923958 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.923939 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.924059 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.924037 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.924167 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.924130 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.924400 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.924379 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-web-config\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:28.929183 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:28.929126 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcnj6\" (UniqueName: \"kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-kube-api-access-mcnj6\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:29.055762 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:29.055709 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81a81f3_158b_4299_8ac9_561a08af5644.slice/crio-4c6231362bf58f4a6b1d1f8d3d58f4f4d601d618a1994553ce35eebd963fc77d WatchSource:0}: Error finding container 4c6231362bf58f4a6b1d1f8d3d58f4f4d601d618a1994553ce35eebd963fc77d: Status 404 returned error can't find the container with id 4c6231362bf58f4a6b1d1f8d3d58f4f4d601d618a1994553ce35eebd963fc77d Sep 09 23:23:29.425777 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:29.425736 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:29.425953 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:29.425810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:29.426581 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:29.426541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:29.428160 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:29.428137 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:29.522868 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:29.522786 2563 generic.go:356] "Generic (PLEG): container finished" podID="28391c32-56a2-44d7-8629-5aa7dc4a38cb" containerID="7c3361015c0f3b2c4a5f0efab237e3f5c404cf5354cff9b430cc80ade850efd3" exitCode=0 Sep 09 23:23:29.523009 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:29.522873 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qk78" event={"ID":"28391c32-56a2-44d7-8629-5aa7dc4a38cb","Type":"ContainerDied","Data":"7c3361015c0f3b2c4a5f0efab237e3f5c404cf5354cff9b430cc80ade850efd3"} Sep 09 23:23:29.524813 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:29.524791 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" event={"ID":"c81a81f3-158b-4299-8ac9-561a08af5644","Type":"ContainerStarted","Data":"200a77e9c78831b06ce23bcb83d7b727c54709c07aa6e5551c35e9019ae6447f"} Sep 09 23:23:29.524907 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:29.524834 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" event={"ID":"c81a81f3-158b-4299-8ac9-561a08af5644","Type":"ContainerStarted","Data":"98e020dbecb60ee8d9d8b653769dca4cfbc2a80211d705125a393bf3da7c33b5"} Sep 09 23:23:29.524907 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:29.524853 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" event={"ID":"c81a81f3-158b-4299-8ac9-561a08af5644","Type":"ContainerStarted","Data":"4c6231362bf58f4a6b1d1f8d3d58f4f4d601d618a1994553ce35eebd963fc77d"} Sep 09 23:23:29.686403 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:29.686370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:23:29.967074 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:29.967041 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:23:30.165978 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:30.165948 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3dd9a70_52bb_43c7_afb8_0d32e26a2f81.slice/crio-1cbfe54621e1f5e1b25d31f6dccb17b4051c0904e2b7150f8bd98b9915f5a92e WatchSource:0}: Error finding container 1cbfe54621e1f5e1b25d31f6dccb17b4051c0904e2b7150f8bd98b9915f5a92e: Status 404 returned error can't find the container with id 1cbfe54621e1f5e1b25d31f6dccb17b4051c0904e2b7150f8bd98b9915f5a92e Sep 09 23:23:30.496713 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.496633 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2wczt" Sep 09 23:23:30.530423 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.530387 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerStarted","Data":"1cbfe54621e1f5e1b25d31f6dccb17b4051c0904e2b7150f8bd98b9915f5a92e"} Sep 09 23:23:30.532869 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.532832 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" event={"ID":"c81a81f3-158b-4299-8ac9-561a08af5644","Type":"ContainerStarted","Data":"05683042a4060c9c293a5140db0b57732f7353b51d370109c5da0dba9dcfab22"} Sep 09 23:23:30.535166 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.535139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qk78" event={"ID":"28391c32-56a2-44d7-8629-5aa7dc4a38cb","Type":"ContainerStarted","Data":"f1c4cd447b0d5a0c0c4ea56ec77b970d91c60923c70d131a463a8e9b35da7de2"} Sep 09 23:23:30.535263 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.535190 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qk78" event={"ID":"28391c32-56a2-44d7-8629-5aa7dc4a38cb","Type":"ContainerStarted","Data":"7290c27ea50438973f2731d70237d2d7427e3d880fd49bcd33bbe5412ad148ee"} Sep 09 23:23:30.554690 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.554607 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rmljm" podStartSLOduration=2.524592797 podStartE2EDuration="3.554589418s" totalImagesPullingTime="1.029996621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:30.553729075 +0000 UTC m=+64.846459673" watchObservedRunningTime="2026-09-09 23:23:30.554589418 +0000 UTC m=+64.847319982" Sep 09 23:23:30.574227 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.574168 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7qk78" podStartSLOduration=2.503608423 podStartE2EDuration="3.57415098s" totalImagesPullingTime="1.000243313s" totalInitContainerRuntime="70.299244ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:30.573960238 +0000 UTC m=+64.866690822" watchObservedRunningTime="2026-09-09 23:23:30.57415098 +0000 UTC m=+64.866881544" Sep 09 23:23:30.698954 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.698914 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-687df7cb7b-5hknp"] Sep 09 23:23:30.704928 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.704896 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.707709 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.707681 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 09 23:23:30.707896 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.707695 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 09 23:23:30.708007 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.707695 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zwwmp\"" Sep 09 23:23:30.708007 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.707964 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3brt13d7j8v6a\"" Sep 09 23:23:30.708181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.707681 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 09 23:23:30.708181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.707807 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 09 23:23:30.708181 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.707749 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 09 23:23:30.712449 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.712428 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-687df7cb7b-5hknp"] Sep 09 23:23:30.738139 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.738104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.738139 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.738141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.738401 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.738254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.738401 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.738318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-metrics-client-ca\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.738401 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.738376 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.738554 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.738409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87p2f\" (UniqueName: \"kubernetes.io/projected/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-kube-api-access-87p2f\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.738554 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.738439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-tls\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.738554 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.738489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-grpc-tls\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.839176 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.839133 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.839367 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.839189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-metrics-client-ca\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.839367 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.839224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.839367 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.839255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87p2f\" (UniqueName: \"kubernetes.io/projected/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-kube-api-access-87p2f\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.839367 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.839283 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-tls\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.839367 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.839332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-grpc-tls\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.839650 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.839414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.839650 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.839446 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.840296 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.840162 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-metrics-client-ca\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.842494 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.842444 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.842494 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.842451 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.842870 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.842845 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.842969 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.842949 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-tls\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.843694 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.843666 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-grpc-tls\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.844429 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.844402 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:30.846998 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:30.846973 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87p2f\" (UniqueName: \"kubernetes.io/projected/7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9-kube-api-access-87p2f\") pod \"thanos-querier-687df7cb7b-5hknp\" (UID: \"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9\") " pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:31.016359 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.016301 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:31.405023 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.404945 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-687df7cb7b-5hknp"] Sep 09 23:23:31.407706 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:31.407675 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3b49ef_bbc0_42f1_ad5b_a7bf07a098e9.slice/crio-c467a192bcfc1b1dbcf3fd8342d4f9018cdc0999c992cae41a653a62c9d19976 WatchSource:0}: Error finding container c467a192bcfc1b1dbcf3fd8342d4f9018cdc0999c992cae41a653a62c9d19976: Status 404 returned error can't find the container with id c467a192bcfc1b1dbcf3fd8342d4f9018cdc0999c992cae41a653a62c9d19976 Sep 09 23:23:31.540146 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.540113 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerID="914b69f6a7aeed480784c2e874f72f8966b4feddc03dd29770cd68a1779f5e01" exitCode=0 Sep 09 23:23:31.540288 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.540204 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerDied","Data":"914b69f6a7aeed480784c2e874f72f8966b4feddc03dd29770cd68a1779f5e01"} Sep 09 23:23:31.541574 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.541543 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" event={"ID":"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9","Type":"ContainerStarted","Data":"c467a192bcfc1b1dbcf3fd8342d4f9018cdc0999c992cae41a653a62c9d19976"} Sep 09 23:23:31.848938 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.848906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhz2l\" (UniqueName: \"kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l\") pod \"network-check-target-pvbp9\" (UID: \"d12e593f-3c8d-43b4-91de-74e053cfbf13\") " pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:31.851586 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.851569 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:23:31.861671 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.861651 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:23:31.872891 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.872869 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhz2l\" (UniqueName: \"kubernetes.io/projected/d12e593f-3c8d-43b4-91de-74e053cfbf13-kube-api-access-xhz2l\") pod \"network-check-target-pvbp9\" (UID: \"d12e593f-3c8d-43b4-91de-74e053cfbf13\") " pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:31.950182 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.950135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:31.950182 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.950190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:31.952795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.952774 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:23:31.952857 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.952774 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:23:31.963004 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.962974 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0d01aef-6642-4f36-841c-4ffbeecd4d46-original-pull-secret\") pod \"global-pull-secret-syncer-hkq6b\" (UID: \"e0d01aef-6642-4f36-841c-4ffbeecd4d46\") " pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:31.963108 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:31.963049 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c-metrics-certs\") pod \"network-metrics-daemon-7cdh4\" (UID: \"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c\") " pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:32.100897 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.100818 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xzm9\"" Sep 09 23:23:32.106766 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.106735 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8xjv6\"" Sep 09 23:23:32.108597 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.108573 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cdh4" Sep 09 23:23:32.108735 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.108692 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkq6b" Sep 09 23:23:32.110626 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.110599 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-747fcc6dd9-zpdnt"] Sep 09 23:23:32.115315 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.115274 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:32.128070 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.128048 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-747fcc6dd9-zpdnt"] Sep 09 23:23:32.128183 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.128145 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.130985 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.130962 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 23:23:32.131194 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.131179 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 09 23:23:32.131458 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.131443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9rwdq\"" Sep 09 23:23:32.131673 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.131658 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 09 23:23:32.132485 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.132467 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 09 23:23:32.132662 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.132647 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3p4q08bve4suc\"" Sep 09 23:23:32.152219 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.152136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-client-ca-bundle\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.152219 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.152184 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-metrics-server-audit-profiles\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.152219 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.152212 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-audit-log\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.152411 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.152248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m6fm\" (UniqueName: \"kubernetes.io/projected/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-kube-api-access-6m6fm\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.152478 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.152431 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-secret-metrics-server-client-certs\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.152478 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.152465 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-secret-metrics-server-tls\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.152587 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.152509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.254334 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.253942 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-secret-metrics-server-client-certs\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.254334 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.253992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-secret-metrics-server-tls\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.254334 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.254035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.254334 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.254071 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-client-ca-bundle\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.254734 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.254638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-metrics-server-audit-profiles\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.254734 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.254699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-audit-log\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.254817 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.254760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m6fm\" (UniqueName: \"kubernetes.io/projected/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-kube-api-access-6m6fm\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.257585 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.255461 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-audit-log\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.257585 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.256333 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-metrics-server-audit-profiles\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.257585 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.256919 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.259766 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.259571 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-secret-metrics-server-client-certs\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.261806 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.260163 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-secret-metrics-server-tls\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.261806 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.261673 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-client-ca-bundle\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.267174 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.267133 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m6fm\" (UniqueName: \"kubernetes.io/projected/34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1-kube-api-access-6m6fm\") pod \"metrics-server-747fcc6dd9-zpdnt\" (UID: \"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1\") " pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.405097 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.405064 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7cdh4"] Sep 09 23:23:32.407991 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:32.407953 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c1d9fb_eb5e_4330_89ff_33ae88e4df0c.slice/crio-9bc9a8ad9fc37010dc654a9f34e8b42011e0f999717670be2b11cf68f88b098a WatchSource:0}: Error finding container 9bc9a8ad9fc37010dc654a9f34e8b42011e0f999717670be2b11cf68f88b098a: Status 404 returned error can't find the container with id 9bc9a8ad9fc37010dc654a9f34e8b42011e0f999717670be2b11cf68f88b098a Sep 09 23:23:32.451699 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.451576 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hkq6b"] Sep 09 23:23:32.455293 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:32.455257 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d01aef_6642_4f36_841c_4ffbeecd4d46.slice/crio-b7b1309989e265e60d4024fdd650739ff983f89ee4d1a88c4cb54ad0b96683e7 WatchSource:0}: Error finding container b7b1309989e265e60d4024fdd650739ff983f89ee4d1a88c4cb54ad0b96683e7: Status 404 returned error can't find the container with id b7b1309989e265e60d4024fdd650739ff983f89ee4d1a88c4cb54ad0b96683e7 Sep 09 23:23:32.463172 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.463136 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:32.490754 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.490672 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pvbp9"] Sep 09 23:23:32.494430 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:32.494263 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12e593f_3c8d_43b4_91de_74e053cfbf13.slice/crio-c7a91aa50fd20b73ed31c35ed02e7b29e47ca7ab8303bd9441cf8641518a8148 WatchSource:0}: Error finding container c7a91aa50fd20b73ed31c35ed02e7b29e47ca7ab8303bd9441cf8641518a8148: Status 404 returned error can't find the container with id c7a91aa50fd20b73ed31c35ed02e7b29e47ca7ab8303bd9441cf8641518a8148 Sep 09 23:23:32.550780 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.550693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hkq6b" event={"ID":"e0d01aef-6642-4f36-841c-4ffbeecd4d46","Type":"ContainerStarted","Data":"b7b1309989e265e60d4024fdd650739ff983f89ee4d1a88c4cb54ad0b96683e7"} Sep 09 23:23:32.552518 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.552441 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pvbp9" event={"ID":"d12e593f-3c8d-43b4-91de-74e053cfbf13","Type":"ContainerStarted","Data":"c7a91aa50fd20b73ed31c35ed02e7b29e47ca7ab8303bd9441cf8641518a8148"} Sep 09 23:23:32.554552 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.554502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7cdh4" event={"ID":"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c","Type":"ContainerStarted","Data":"9bc9a8ad9fc37010dc654a9f34e8b42011e0f999717670be2b11cf68f88b098a"} Sep 09 23:23:32.764237 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:32.764159 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-747fcc6dd9-zpdnt"] Sep 09 23:23:32.767567 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:32.767541 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34406ed2_9d44_4ea2_a9bf_58c0e0ee3fb1.slice/crio-08e6d3e9b87081808e07130dd4142330da95ca09d165dbc5ffd339437a188849 WatchSource:0}: Error finding container 08e6d3e9b87081808e07130dd4142330da95ca09d165dbc5ffd339437a188849: Status 404 returned error can't find the container with id 08e6d3e9b87081808e07130dd4142330da95ca09d165dbc5ffd339437a188849 Sep 09 23:23:33.563262 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:33.563178 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" event={"ID":"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1","Type":"ContainerStarted","Data":"08e6d3e9b87081808e07130dd4142330da95ca09d165dbc5ffd339437a188849"} Sep 09 23:23:34.575127 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:34.574789 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerStarted","Data":"894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7"} Sep 09 23:23:34.575127 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:34.574873 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerStarted","Data":"a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17"} Sep 09 23:23:34.575127 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:34.574918 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerStarted","Data":"151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866"} Sep 09 23:23:34.575127 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:34.574959 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerStarted","Data":"95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b"} Sep 09 23:23:34.575127 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:34.574996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerStarted","Data":"0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db"} Sep 09 23:23:34.578883 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:34.578729 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" event={"ID":"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9","Type":"ContainerStarted","Data":"2465e45c606431ddd3c15dda3ac5e88da346834dd43c64b696847451886305f3"} Sep 09 23:23:34.578883 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:34.578802 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" event={"ID":"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9","Type":"ContainerStarted","Data":"610340d9d7924b384b050338f96c60ab64bc4d930022a53b68fc4e0d876be175"} Sep 09 23:23:34.578883 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:34.578846 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" event={"ID":"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9","Type":"ContainerStarted","Data":"25e9c43e5ebe2393714ab48d609c2f667d3e444850baffd1962caf384f2e9ec9"} Sep 09 23:23:36.376257 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:36.376208 2563 patch_prober.go:28] interesting pod/image-registry-c9898c6f4-qxcsd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:23:36.376833 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:36.376270 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" podUID="4ab3e715-dcbf-4db3-8b76-549541573136" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:23:38.482325 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.482281 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c9898c6f4-qxcsd" Sep 09 23:23:38.598029 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.597989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pvbp9" event={"ID":"d12e593f-3c8d-43b4-91de-74e053cfbf13","Type":"ContainerStarted","Data":"4db11fe8c974ff76c3c334fd852d5caf5b849e4139de82002ef542328517891c"} Sep 09 23:23:38.598205 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.598112 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:23:38.600002 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.599976 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7cdh4" event={"ID":"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c","Type":"ContainerStarted","Data":"d1658df3de143a42b6d84a86143db2af945634796532e80dca12d31be654347f"} Sep 09 23:23:38.600123 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.600023 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7cdh4" event={"ID":"b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c","Type":"ContainerStarted","Data":"7c8aeaa6b20b9342a89b66c4e30452f0e7daea87cbaae7b6ebfc5d17495ccccc"} Sep 09 23:23:38.603479 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.603456 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerStarted","Data":"157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a"} Sep 09 23:23:38.606568 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.606543 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" event={"ID":"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9","Type":"ContainerStarted","Data":"dc8219582daac9f43a1065f808e950802dbd2f44bf04a916bb63b47dfac1ca4b"} Sep 09 23:23:38.606671 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.606612 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" event={"ID":"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9","Type":"ContainerStarted","Data":"8a294c53b36604bed9aeffc10de24cba9353ddba960352c5a010b12cd242607c"} Sep 09 23:23:38.606671 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.606657 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" event={"ID":"7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9","Type":"ContainerStarted","Data":"c809c50e4f368914b90cb8d550712ec6eff4dd05591a2aefa6556a0c25d33ade"} Sep 09 23:23:38.606765 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.606702 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:38.607999 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.607975 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hkq6b" event={"ID":"e0d01aef-6642-4f36-841c-4ffbeecd4d46","Type":"ContainerStarted","Data":"9c7cbb8f72bcbee7d965772b3eff89a019d2837d39915078d4fc25db1d42fa77"} Sep 09 23:23:38.609484 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.609462 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" event={"ID":"34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1","Type":"ContainerStarted","Data":"5689dca2fc018e430319c59c8dbf354a9b18271d26875aef5afb2dc50cc15869"} Sep 09 23:23:38.627399 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.627337 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pvbp9" podStartSLOduration=67.190440077 podStartE2EDuration="1m12.627319598s" totalImagesPullingTime="5.436879521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:38.612297651 +0000 UTC m=+72.905028248" watchObservedRunningTime="2026-09-09 23:23:38.627319598 +0000 UTC m=+72.920050197" Sep 09 23:23:38.627803 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.627763 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7cdh4" podStartSLOduration=67.1048843 podStartE2EDuration="1m12.627749402s" totalImagesPullingTime="5.522865102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:38.627469204 +0000 UTC m=+72.920199761" watchObservedRunningTime="2026-09-09 23:23:38.627749402 +0000 UTC m=+72.920479970" Sep 09 23:23:38.644985 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.644901 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" podStartSLOduration=1.480941988 podStartE2EDuration="6.644885676s" totalImagesPullingTime="5.163943688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:38.644350248 +0000 UTC m=+72.937080838" watchObservedRunningTime="2026-09-09 23:23:38.644885676 +0000 UTC m=+72.937616241" Sep 09 23:23:38.659632 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.659582 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hkq6b" podStartSLOduration=67.183494424 podStartE2EDuration="1m12.659562646s" totalImagesPullingTime="5.476068222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:38.658261197 +0000 UTC m=+72.950991761" watchObservedRunningTime="2026-09-09 23:23:38.659562646 +0000 UTC m=+72.952293212" Sep 09 23:23:38.680480 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.680429 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" podStartSLOduration=2.377769934 podStartE2EDuration="8.680413121s" totalImagesPullingTime="6.302643187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:38.679114772 +0000 UTC m=+72.971845356" watchObservedRunningTime="2026-09-09 23:23:38.680413121 +0000 UTC m=+72.973143686" Sep 09 23:23:38.707405 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:38.707356 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.657822844 podStartE2EDuration="10.707340098s" totalImagesPullingTime="7.032650989s" totalInitContainerRuntime="16.866265ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:38.704859992 +0000 UTC m=+72.997590556" watchObservedRunningTime="2026-09-09 23:23:38.707340098 +0000 UTC m=+73.000070672" Sep 09 23:23:39.619827 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:39.619800 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-687df7cb7b-5hknp" Sep 09 23:23:43.111950 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:43.111912 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-8wltq"] Sep 09 23:23:43.115315 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:43.115287 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-8wltq" Sep 09 23:23:43.117949 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:43.117929 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 23:23:43.118108 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:43.118092 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zrphq\"" Sep 09 23:23:43.118196 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:43.118181 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 23:23:43.123770 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:43.123746 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-8wltq"] Sep 09 23:23:43.152553 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:43.152520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xc9p\" (UniqueName: \"kubernetes.io/projected/e4d346e3-f06f-4e71-9622-bde8d34fb453-kube-api-access-4xc9p\") pod \"downloads-85d98c998f-8wltq\" (UID: \"e4d346e3-f06f-4e71-9622-bde8d34fb453\") " pod="openshift-console/downloads-85d98c998f-8wltq" Sep 09 23:23:43.253961 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:43.253917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc9p\" (UniqueName: \"kubernetes.io/projected/e4d346e3-f06f-4e71-9622-bde8d34fb453-kube-api-access-4xc9p\") pod \"downloads-85d98c998f-8wltq\" (UID: \"e4d346e3-f06f-4e71-9622-bde8d34fb453\") " pod="openshift-console/downloads-85d98c998f-8wltq" Sep 09 23:23:43.262163 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:43.262137 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xc9p\" (UniqueName: \"kubernetes.io/projected/e4d346e3-f06f-4e71-9622-bde8d34fb453-kube-api-access-4xc9p\") pod \"downloads-85d98c998f-8wltq\" (UID: \"e4d346e3-f06f-4e71-9622-bde8d34fb453\") " pod="openshift-console/downloads-85d98c998f-8wltq" Sep 09 23:23:43.425483 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:43.425380 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-8wltq" Sep 09 23:23:43.699789 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:43.699759 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-8wltq"] Sep 09 23:23:43.702223 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:43.702191 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d346e3_f06f_4e71_9622_bde8d34fb453.slice/crio-d4a7d0f4f093e5696ae8bba0690baae651014ad4b8e686c9ca33571a04a05c7d WatchSource:0}: Error finding container d4a7d0f4f093e5696ae8bba0690baae651014ad4b8e686c9ca33571a04a05c7d: Status 404 returned error can't find the container with id d4a7d0f4f093e5696ae8bba0690baae651014ad4b8e686c9ca33571a04a05c7d Sep 09 23:23:44.633377 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:44.633335 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-8wltq" event={"ID":"e4d346e3-f06f-4e71-9622-bde8d34fb453","Type":"ContainerStarted","Data":"d4a7d0f4f093e5696ae8bba0690baae651014ad4b8e686c9ca33571a04a05c7d"} Sep 09 23:23:52.463874 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:52.463728 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:52.463874 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:52.463808 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:23:53.823795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.823762 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b6c865764-6mb52"] Sep 09 23:23:53.827428 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.827400 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:53.830139 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.830111 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2l2st\"" Sep 09 23:23:53.831076 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.831053 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 23:23:53.831400 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.831381 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 23:23:53.831514 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.831415 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 23:23:53.831514 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.831430 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 23:23:53.831633 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.831504 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 23:23:53.835279 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.835254 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6c865764-6mb52"] Sep 09 23:23:53.950661 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.950583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-console-config\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:53.950860 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.950704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-oauth-config\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:53.950860 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.950749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-service-ca\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:53.950860 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.950775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-oauth-serving-cert\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:53.950860 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.950797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-serving-cert\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:53.950860 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:53.950825 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cbz2\" (UniqueName: \"kubernetes.io/projected/3167cea9-9763-4467-ab41-26a64f6d674e-kube-api-access-7cbz2\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.052021 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.051983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-oauth-config\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.052220 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.052035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-service-ca\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.052286 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.052261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-oauth-serving-cert\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.052387 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.052319 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-serving-cert\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.052387 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.052356 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cbz2\" (UniqueName: \"kubernetes.io/projected/3167cea9-9763-4467-ab41-26a64f6d674e-kube-api-access-7cbz2\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.052507 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.052386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-console-config\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.052953 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.052892 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-service-ca\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.053077 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.053018 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-console-config\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.053171 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.053150 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-oauth-serving-cert\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.055197 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.055167 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-oauth-config\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.055197 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.055198 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-serving-cert\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.062730 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.062680 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cbz2\" (UniqueName: \"kubernetes.io/projected/3167cea9-9763-4467-ab41-26a64f6d674e-kube-api-access-7cbz2\") pod \"console-b6c865764-6mb52\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:54.140262 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:54.140177 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:23:59.974912 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:23:59.974830 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6c865764-6mb52"] Sep 09 23:23:59.978044 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:23:59.978013 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3167cea9_9763_4467_ab41_26a64f6d674e.slice/crio-2263cd645542eae2d40b3d0a575be7dcab7e413bfdedfff4d3fa16afbeb9d9f9 WatchSource:0}: Error finding container 2263cd645542eae2d40b3d0a575be7dcab7e413bfdedfff4d3fa16afbeb9d9f9: Status 404 returned error can't find the container with id 2263cd645542eae2d40b3d0a575be7dcab7e413bfdedfff4d3fa16afbeb9d9f9 Sep 09 23:24:00.706615 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:00.706571 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-8wltq" event={"ID":"e4d346e3-f06f-4e71-9622-bde8d34fb453","Type":"ContainerStarted","Data":"af3d9304d00fa1ca815eed2e6564c22f4632a1f20547b10d52d78de6383dcae4"} Sep 09 23:24:00.706821 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:00.706678 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-8wltq" Sep 09 23:24:00.708565 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:00.708513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6c865764-6mb52" event={"ID":"3167cea9-9763-4467-ab41-26a64f6d674e","Type":"ContainerStarted","Data":"2263cd645542eae2d40b3d0a575be7dcab7e413bfdedfff4d3fa16afbeb9d9f9"} Sep 09 23:24:00.725187 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:00.725127 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-8wltq" podStartSLOduration=1.623013185 podStartE2EDuration="17.725107494s" totalImagesPullingTime="16.102094309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:24:00.72382911 +0000 UTC m=+95.016559693" watchObservedRunningTime="2026-09-09 23:24:00.725107494 +0000 UTC m=+95.017838060" Sep 09 23:24:00.726380 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:00.726357 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-8wltq" Sep 09 23:24:03.442871 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.442832 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d8c7ff5d4-9q78c"] Sep 09 23:24:03.461445 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.461414 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d8c7ff5d4-9q78c"] Sep 09 23:24:03.461604 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.461496 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.470074 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.470050 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 23:24:03.644376 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.644330 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-service-ca\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.644561 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.644404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-oauth-serving-cert\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.644561 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.644437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-oauth-config\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.644561 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.644457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5zmg\" (UniqueName: \"kubernetes.io/projected/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-kube-api-access-z5zmg\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.644561 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.644487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-config\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.644752 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.644595 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-trusted-ca-bundle\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.644752 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.644638 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-serving-cert\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.745749 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.745664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-trusted-ca-bundle\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.745749 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.745715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-serving-cert\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.745981 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.745907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-service-ca\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.746048 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.745995 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-oauth-serving-cert\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.746048 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.746027 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-oauth-config\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.746150 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.746047 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5zmg\" (UniqueName: \"kubernetes.io/projected/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-kube-api-access-z5zmg\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.746150 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.746082 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-config\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.746669 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.746641 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-trusted-ca-bundle\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.746794 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.746669 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-oauth-serving-cert\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.746794 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.746676 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-service-ca\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.746794 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.746764 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-config\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.748798 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.748773 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-serving-cert\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.748798 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.748785 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-oauth-config\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.754130 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.754103 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5zmg\" (UniqueName: \"kubernetes.io/projected/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-kube-api-access-z5zmg\") pod \"console-6d8c7ff5d4-9q78c\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:03.773059 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:03.773033 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:04.110443 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:04.110408 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d8c7ff5d4-9q78c"] Sep 09 23:24:04.113829 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:24:04.113798 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd102b2_cfc1_4ed9_a14d_074c732fcd75.slice/crio-1a3d91d53f0853fb652474dcf35ad6544fe7587abab4d6abe0d56f2a6e032e96 WatchSource:0}: Error finding container 1a3d91d53f0853fb652474dcf35ad6544fe7587abab4d6abe0d56f2a6e032e96: Status 404 returned error can't find the container with id 1a3d91d53f0853fb652474dcf35ad6544fe7587abab4d6abe0d56f2a6e032e96 Sep 09 23:24:04.731111 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:04.731065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6c865764-6mb52" event={"ID":"3167cea9-9763-4467-ab41-26a64f6d674e","Type":"ContainerStarted","Data":"4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe"} Sep 09 23:24:04.733013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:04.732979 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8c7ff5d4-9q78c" event={"ID":"9fd102b2-cfc1-4ed9-a14d-074c732fcd75","Type":"ContainerStarted","Data":"a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7"} Sep 09 23:24:04.733144 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:04.733030 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8c7ff5d4-9q78c" event={"ID":"9fd102b2-cfc1-4ed9-a14d-074c732fcd75","Type":"ContainerStarted","Data":"1a3d91d53f0853fb652474dcf35ad6544fe7587abab4d6abe0d56f2a6e032e96"} Sep 09 23:24:04.747881 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:04.747831 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b6c865764-6mb52" podStartSLOduration=7.892310855 podStartE2EDuration="11.747811841s" totalImagesPullingTime="3.855500986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:24:04.747532421 +0000 UTC m=+99.040262988" watchObservedRunningTime="2026-09-09 23:24:04.747811841 +0000 UTC m=+99.040542395" Sep 09 23:24:04.766623 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:04.766542 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d8c7ff5d4-9q78c" podStartSLOduration=1.766524656 podStartE2EDuration="1.766524656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:24:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:24:04.765396797 +0000 UTC m=+99.058127386" watchObservedRunningTime="2026-09-09 23:24:04.766524656 +0000 UTC m=+99.059255221" Sep 09 23:24:07.585017 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:07.584951 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f4xtd_7814455e-89ca-49a3-ba29-f6048db57aef/serve-healthcheck-canary/0.log" Sep 09 23:24:09.616851 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:09.616818 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pvbp9" Sep 09 23:24:12.469360 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:12.469324 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:24:12.473493 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:12.473462 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-747fcc6dd9-zpdnt" Sep 09 23:24:13.773491 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:13.773457 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:13.773957 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:13.773510 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:13.778429 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:13.778404 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:14.140304 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:14.140264 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:24:14.140497 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:14.140356 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:24:14.144933 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:14.144902 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:24:14.777034 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:14.777004 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:24:14.777459 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:14.777442 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:24:14.840357 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:14.840327 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6c865764-6mb52"] Sep 09 23:24:41.801170 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:41.801118 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b6c865764-6mb52" podUID="3167cea9-9763-4467-ab41-26a64f6d674e" containerName="console" containerID="cri-o://4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe" gracePeriod=15 Sep 09 23:24:42.068545 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.068524 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:24:42.171519 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.171478 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-oauth-serving-cert\") pod \"3167cea9-9763-4467-ab41-26a64f6d674e\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " Sep 09 23:24:42.171519 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.171523 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-oauth-config\") pod \"3167cea9-9763-4467-ab41-26a64f6d674e\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " Sep 09 23:24:42.171745 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.171548 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-service-ca\") pod \"3167cea9-9763-4467-ab41-26a64f6d674e\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " Sep 09 23:24:42.171745 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.171592 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cbz2\" (UniqueName: \"kubernetes.io/projected/3167cea9-9763-4467-ab41-26a64f6d674e-kube-api-access-7cbz2\") pod \"3167cea9-9763-4467-ab41-26a64f6d674e\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " Sep 09 23:24:42.171745 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.171615 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-serving-cert\") pod \"3167cea9-9763-4467-ab41-26a64f6d674e\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " Sep 09 23:24:42.171745 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.171644 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-console-config\") pod \"3167cea9-9763-4467-ab41-26a64f6d674e\" (UID: \"3167cea9-9763-4467-ab41-26a64f6d674e\") " Sep 09 23:24:42.172093 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.172057 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-service-ca" (OuterVolumeSpecName: "service-ca") pod "3167cea9-9763-4467-ab41-26a64f6d674e" (UID: "3167cea9-9763-4467-ab41-26a64f6d674e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:24:42.172201 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.172129 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3167cea9-9763-4467-ab41-26a64f6d674e" (UID: "3167cea9-9763-4467-ab41-26a64f6d674e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:24:42.172201 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.172141 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-console-config" (OuterVolumeSpecName: "console-config") pod "3167cea9-9763-4467-ab41-26a64f6d674e" (UID: "3167cea9-9763-4467-ab41-26a64f6d674e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:24:42.173935 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.173912 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3167cea9-9763-4467-ab41-26a64f6d674e" (UID: "3167cea9-9763-4467-ab41-26a64f6d674e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:24:42.174222 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.174198 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3167cea9-9763-4467-ab41-26a64f6d674e" (UID: "3167cea9-9763-4467-ab41-26a64f6d674e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:24:42.174222 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.174212 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3167cea9-9763-4467-ab41-26a64f6d674e-kube-api-access-7cbz2" (OuterVolumeSpecName: "kube-api-access-7cbz2") pod "3167cea9-9763-4467-ab41-26a64f6d674e" (UID: "3167cea9-9763-4467-ab41-26a64f6d674e"). InnerVolumeSpecName "kube-api-access-7cbz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:24:42.273302 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.273266 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-oauth-serving-cert\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:42.273302 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.273292 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-oauth-config\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:42.273302 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.273301 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-service-ca\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:42.273302 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.273327 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cbz2\" (UniqueName: \"kubernetes.io/projected/3167cea9-9763-4467-ab41-26a64f6d674e-kube-api-access-7cbz2\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:42.273624 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.273337 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3167cea9-9763-4467-ab41-26a64f6d674e-console-serving-cert\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:42.273624 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.273347 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3167cea9-9763-4467-ab41-26a64f6d674e-console-config\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:42.886567 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.886529 2563 generic.go:356] "Generic (PLEG): container finished" podID="3167cea9-9763-4467-ab41-26a64f6d674e" containerID="4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe" exitCode=0 Sep 09 23:24:42.886976 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.886594 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6c865764-6mb52" Sep 09 23:24:42.886976 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.886618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6c865764-6mb52" event={"ID":"3167cea9-9763-4467-ab41-26a64f6d674e","Type":"ContainerDied","Data":"4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe"} Sep 09 23:24:42.886976 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.886682 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6c865764-6mb52" event={"ID":"3167cea9-9763-4467-ab41-26a64f6d674e","Type":"ContainerDied","Data":"2263cd645542eae2d40b3d0a575be7dcab7e413bfdedfff4d3fa16afbeb9d9f9"} Sep 09 23:24:42.886976 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.886705 2563 scope.go:117] "RemoveContainer" containerID="4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe" Sep 09 23:24:42.895159 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.895134 2563 scope.go:117] "RemoveContainer" containerID="4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe" Sep 09 23:24:42.895459 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:24:42.895441 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe\": container with ID starting with 4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe not found: ID does not exist" containerID="4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe" Sep 09 23:24:42.895539 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.895469 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe"} err="failed to get container status \"4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe\": rpc error: code = NotFound desc = could not find container \"4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe\": container with ID starting with 4eb18878e7139ff0d3aa9fbee1f914d81b03b8c3e8c58d67662544cada647efe not found: ID does not exist" Sep 09 23:24:42.903097 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.903073 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6c865764-6mb52"] Sep 09 23:24:42.907440 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:42.907421 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b6c865764-6mb52"] Sep 09 23:24:44.191518 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:44.191480 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3167cea9-9763-4467-ab41-26a64f6d674e" path="/var/lib/kubelet/pods/3167cea9-9763-4467-ab41-26a64f6d674e/volumes" Sep 09 23:24:47.965336 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:47.965264 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:24:47.965915 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:47.965722 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="alertmanager" containerID="cri-o://0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db" gracePeriod=120 Sep 09 23:24:47.965915 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:47.965802 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy-metric" containerID="cri-o://894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7" gracePeriod=120 Sep 09 23:24:47.965915 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:47.965833 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy" containerID="cri-o://a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17" gracePeriod=120 Sep 09 23:24:47.965915 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:47.965872 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="prom-label-proxy" containerID="cri-o://157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a" gracePeriod=120 Sep 09 23:24:47.966133 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:47.965816 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="config-reloader" containerID="cri-o://95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b" gracePeriod=120 Sep 09 23:24:47.966133 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:47.965804 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy-web" containerID="cri-o://151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866" gracePeriod=120 Sep 09 23:24:48.916700 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:48.916667 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerID="157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a" exitCode=0 Sep 09 23:24:48.916700 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:48.916693 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerID="894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7" exitCode=0 Sep 09 23:24:48.916700 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:48.916699 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerID="a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17" exitCode=0 Sep 09 23:24:48.916700 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:48.916705 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerID="95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b" exitCode=0 Sep 09 23:24:48.916965 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:48.916712 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerID="0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db" exitCode=0 Sep 09 23:24:48.916965 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:48.916737 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerDied","Data":"157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a"} Sep 09 23:24:48.916965 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:48.916808 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerDied","Data":"894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7"} Sep 09 23:24:48.916965 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:48.916837 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerDied","Data":"a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17"} Sep 09 23:24:48.916965 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:48.916862 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerDied","Data":"95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b"} Sep 09 23:24:48.916965 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:48.916886 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerDied","Data":"0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db"} Sep 09 23:24:49.204655 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.204629 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:49.330282 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330239 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.330282 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330289 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-volume\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.330561 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330337 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-main-tls\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.330561 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330440 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-web-config\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.330561 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330489 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-main-db\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.330561 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330551 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-out\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.330777 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330579 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-cluster-tls-config\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.330777 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330615 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-tls-assets\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.330777 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330654 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.330777 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330715 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-trusted-ca-bundle\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.330777 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330754 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-web\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.331005 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330790 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-metrics-client-ca\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.331005 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.330831 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcnj6\" (UniqueName: \"kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-kube-api-access-mcnj6\") pod \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\" (UID: \"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81\") " Sep 09 23:24:49.331121 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.331092 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:24:49.333436 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.333405 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:24:49.333968 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.333903 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:24:49.334192 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.334137 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:24:49.334264 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.334238 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-out" (OuterVolumeSpecName: "config-out") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:24:49.334691 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.334429 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:24:49.335165 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.334970 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:24:49.335165 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.335106 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:24:49.335480 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.335301 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-kube-api-access-mcnj6" (OuterVolumeSpecName: "kube-api-access-mcnj6") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "kube-api-access-mcnj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:24:49.335586 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.335439 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-volume" (OuterVolumeSpecName: "config-volume") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:24:49.335958 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.335937 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:24:49.340080 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.340058 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:24:49.344801 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.344778 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-web-config" (OuterVolumeSpecName: "web-config") pod "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" (UID: "e3dd9a70-52bb-43c7-afb8-0d32e26a2f81"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:24:49.432024 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.431973 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432024 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432021 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-volume\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432024 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432031 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-main-tls\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432024 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432043 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-web-config\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432298 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432052 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-main-db\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432298 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432060 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-config-out\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432298 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432068 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-cluster-tls-config\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432298 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432076 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-tls-assets\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432298 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432085 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432298 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432094 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432298 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432103 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432298 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432112 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-metrics-client-ca\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.432298 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.432120 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcnj6\" (UniqueName: \"kubernetes.io/projected/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81-kube-api-access-mcnj6\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:24:49.923819 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.923782 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerID="151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866" exitCode=0 Sep 09 23:24:49.924017 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.923849 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerDied","Data":"151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866"} Sep 09 23:24:49.924017 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.923876 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:49.924017 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.923907 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3dd9a70-52bb-43c7-afb8-0d32e26a2f81","Type":"ContainerDied","Data":"1cbfe54621e1f5e1b25d31f6dccb17b4051c0904e2b7150f8bd98b9915f5a92e"} Sep 09 23:24:49.924017 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.923939 2563 scope.go:117] "RemoveContainer" containerID="157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a" Sep 09 23:24:49.931634 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.931614 2563 scope.go:117] "RemoveContainer" containerID="894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7" Sep 09 23:24:49.939072 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.939053 2563 scope.go:117] "RemoveContainer" containerID="a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17" Sep 09 23:24:49.945749 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.945731 2563 scope.go:117] "RemoveContainer" containerID="151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866" Sep 09 23:24:49.951783 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.951758 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:24:49.952707 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.952692 2563 scope.go:117] "RemoveContainer" containerID="95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b" Sep 09 23:24:49.959708 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.959686 2563 scope.go:117] "RemoveContainer" containerID="0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db" Sep 09 23:24:49.960978 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.960960 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:24:49.966649 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.966627 2563 scope.go:117] "RemoveContainer" containerID="914b69f6a7aeed480784c2e874f72f8966b4feddc03dd29770cd68a1779f5e01" Sep 09 23:24:49.973457 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.973439 2563 scope.go:117] "RemoveContainer" containerID="157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a" Sep 09 23:24:49.973734 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:24:49.973716 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a\": container with ID starting with 157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a not found: ID does not exist" containerID="157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a" Sep 09 23:24:49.973781 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.973743 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a"} err="failed to get container status \"157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a\": rpc error: code = NotFound desc = could not find container \"157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a\": container with ID starting with 157f76b7131cfe5a1c2cc8594d2c138f9c50a2ebab28681899bb975092794f5a not found: ID does not exist" Sep 09 23:24:49.973781 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.973761 2563 scope.go:117] "RemoveContainer" containerID="894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7" Sep 09 23:24:49.973999 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:24:49.973983 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7\": container with ID starting with 894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7 not found: ID does not exist" containerID="894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7" Sep 09 23:24:49.974047 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.974006 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7"} err="failed to get container status \"894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7\": rpc error: code = NotFound desc = could not find container \"894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7\": container with ID starting with 894f5a44f88378ccc5a57c4069b3e62efed11ef0315ded00ab49772df9a568d7 not found: ID does not exist" Sep 09 23:24:49.974047 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.974020 2563 scope.go:117] "RemoveContainer" containerID="a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17" Sep 09 23:24:49.974208 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:24:49.974193 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17\": container with ID starting with a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17 not found: ID does not exist" containerID="a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17" Sep 09 23:24:49.974247 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.974212 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17"} err="failed to get container status \"a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17\": rpc error: code = NotFound desc = could not find container \"a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17\": container with ID starting with a2665040248af2c9ad7ec728b08d49d20b2797612f3d80666a0c2ea0c0146a17 not found: ID does not exist" Sep 09 23:24:49.974247 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.974224 2563 scope.go:117] "RemoveContainer" containerID="151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866" Sep 09 23:24:49.974485 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:24:49.974463 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866\": container with ID starting with 151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866 not found: ID does not exist" containerID="151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866" Sep 09 23:24:49.974573 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.974489 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866"} err="failed to get container status \"151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866\": rpc error: code = NotFound desc = could not find container \"151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866\": container with ID starting with 151e06ddd9f9d245d2c8b149bb05899c35fb1a9f72d2f23f04e0e1ba647d6866 not found: ID does not exist" Sep 09 23:24:49.974573 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.974510 2563 scope.go:117] "RemoveContainer" containerID="95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b" Sep 09 23:24:49.974762 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:24:49.974746 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b\": container with ID starting with 95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b not found: ID does not exist" containerID="95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b" Sep 09 23:24:49.974821 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.974769 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b"} err="failed to get container status \"95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b\": rpc error: code = NotFound desc = could not find container \"95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b\": container with ID starting with 95be88baa56e6695ed374cd6fff8e08d40040cd0e1075d8e210fa141b456c56b not found: ID does not exist" Sep 09 23:24:49.974821 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.974788 2563 scope.go:117] "RemoveContainer" containerID="0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db" Sep 09 23:24:49.975032 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:24:49.975014 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db\": container with ID starting with 0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db not found: ID does not exist" containerID="0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db" Sep 09 23:24:49.975072 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.975037 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db"} err="failed to get container status \"0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db\": rpc error: code = NotFound desc = could not find container \"0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db\": container with ID starting with 0a72b23ec52d64ac46ce5581e86d7d542bacf366e5d08278ae2bc03e3f0412db not found: ID does not exist" Sep 09 23:24:49.975072 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.975051 2563 scope.go:117] "RemoveContainer" containerID="914b69f6a7aeed480784c2e874f72f8966b4feddc03dd29770cd68a1779f5e01" Sep 09 23:24:49.975268 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:24:49.975249 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"914b69f6a7aeed480784c2e874f72f8966b4feddc03dd29770cd68a1779f5e01\": container with ID starting with 914b69f6a7aeed480784c2e874f72f8966b4feddc03dd29770cd68a1779f5e01 not found: ID does not exist" containerID="914b69f6a7aeed480784c2e874f72f8966b4feddc03dd29770cd68a1779f5e01" Sep 09 23:24:49.975324 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:49.975272 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"914b69f6a7aeed480784c2e874f72f8966b4feddc03dd29770cd68a1779f5e01"} err="failed to get container status \"914b69f6a7aeed480784c2e874f72f8966b4feddc03dd29770cd68a1779f5e01\": rpc error: code = NotFound desc = could not find container \"914b69f6a7aeed480784c2e874f72f8966b4feddc03dd29770cd68a1779f5e01\": container with ID starting with 914b69f6a7aeed480784c2e874f72f8966b4feddc03dd29770cd68a1779f5e01 not found: ID does not exist" Sep 09 23:24:50.014345 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014297 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:24:50.014585 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014573 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="init-config-reloader" Sep 09 23:24:50.014627 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014587 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="init-config-reloader" Sep 09 23:24:50.014627 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014596 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy" Sep 09 23:24:50.014627 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014602 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy" Sep 09 23:24:50.014627 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014611 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="config-reloader" Sep 09 23:24:50.014627 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014616 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="config-reloader" Sep 09 23:24:50.014627 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014627 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy-metric" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014633 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy-metric" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014638 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="prom-label-proxy" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014643 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="prom-label-proxy" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014650 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3167cea9-9763-4467-ab41-26a64f6d674e" containerName="console" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014655 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3167cea9-9763-4467-ab41-26a64f6d674e" containerName="console" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014661 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="alertmanager" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014667 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="alertmanager" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014676 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy-web" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014681 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy-web" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014721 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="config-reloader" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014727 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy-web" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014734 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="alertmanager" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014740 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy-metric" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014745 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="prom-label-proxy" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014750 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3167cea9-9763-4467-ab41-26a64f6d674e" containerName="console" Sep 09 23:24:50.014795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.014755 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" containerName="kube-rbac-proxy" Sep 09 23:24:50.017990 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.017974 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.023280 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.023255 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 23:24:50.023541 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.023526 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 23:24:50.023620 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.023528 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 23:24:50.023775 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.023756 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jnbp4\"" Sep 09 23:24:50.024239 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.024043 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 23:24:50.024504 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.024480 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 23:24:50.024632 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.024514 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 23:24:50.024632 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.024544 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 23:24:50.024742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.024684 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 23:24:50.033359 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.033337 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 23:24:50.039187 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.039162 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:24:50.139296 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89c7e22d-7a48-490d-9529-8db0bce5e081-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139296 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89c7e22d-7a48-490d-9529-8db0bce5e081-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139504 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l47j\" (UniqueName: \"kubernetes.io/projected/89c7e22d-7a48-490d-9529-8db0bce5e081-kube-api-access-8l47j\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139504 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139388 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139504 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139405 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139504 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139423 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89c7e22d-7a48-490d-9529-8db0bce5e081-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139504 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139473 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139674 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-web-config\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139674 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-config-volume\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139674 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89c7e22d-7a48-490d-9529-8db0bce5e081-config-out\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139674 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139674 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89c7e22d-7a48-490d-9529-8db0bce5e081-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.139674 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.139673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.191818 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.191728 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3dd9a70-52bb-43c7-afb8-0d32e26a2f81" path="/var/lib/kubelet/pods/e3dd9a70-52bb-43c7-afb8-0d32e26a2f81/volumes" Sep 09 23:24:50.241076 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241025 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89c7e22d-7a48-490d-9529-8db0bce5e081-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.241076 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l47j\" (UniqueName: \"kubernetes.io/projected/89c7e22d-7a48-490d-9529-8db0bce5e081-kube-api-access-8l47j\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.241589 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.241589 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.241589 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89c7e22d-7a48-490d-9529-8db0bce5e081-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.241589 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.241589 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241180 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-web-config\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.241589 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241213 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-config-volume\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.241589 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89c7e22d-7a48-490d-9529-8db0bce5e081-config-out\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.241589 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241518 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89c7e22d-7a48-490d-9529-8db0bce5e081-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.241589 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.242041 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241631 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89c7e22d-7a48-490d-9529-8db0bce5e081-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.242041 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.242041 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.241701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89c7e22d-7a48-490d-9529-8db0bce5e081-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.242432 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.242405 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89c7e22d-7a48-490d-9529-8db0bce5e081-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.244092 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.244066 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89c7e22d-7a48-490d-9529-8db0bce5e081-config-out\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.244303 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.244275 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-web-config\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.244403 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.244354 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.244464 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.244413 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89c7e22d-7a48-490d-9529-8db0bce5e081-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.244528 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.244459 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-config-volume\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.244742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.244715 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.245043 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.245018 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89c7e22d-7a48-490d-9529-8db0bce5e081-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.245112 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.245092 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.245384 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.245367 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.246279 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.246258 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89c7e22d-7a48-490d-9529-8db0bce5e081-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.249370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.249340 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l47j\" (UniqueName: \"kubernetes.io/projected/89c7e22d-7a48-490d-9529-8db0bce5e081-kube-api-access-8l47j\") pod \"alertmanager-main-0\" (UID: \"89c7e22d-7a48-490d-9529-8db0bce5e081\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.331043 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.331004 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:24:50.612630 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.612498 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:24:50.615192 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:24:50.615168 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c7e22d_7a48_490d_9529_8db0bce5e081.slice/crio-84bb1b8bc3946d8fd22029c2e8cabc2145762796f37e69c0d97ab989afc495ae WatchSource:0}: Error finding container 84bb1b8bc3946d8fd22029c2e8cabc2145762796f37e69c0d97ab989afc495ae: Status 404 returned error can't find the container with id 84bb1b8bc3946d8fd22029c2e8cabc2145762796f37e69c0d97ab989afc495ae Sep 09 23:24:50.930096 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.929998 2563 generic.go:356] "Generic (PLEG): container finished" podID="89c7e22d-7a48-490d-9529-8db0bce5e081" containerID="6b78601432d82a7e23a0133973f28909c32e8cc68ef7576d4a2bc9f24fd69c87" exitCode=0 Sep 09 23:24:50.930096 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.930074 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89c7e22d-7a48-490d-9529-8db0bce5e081","Type":"ContainerDied","Data":"6b78601432d82a7e23a0133973f28909c32e8cc68ef7576d4a2bc9f24fd69c87"} Sep 09 23:24:50.930289 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:50.930144 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89c7e22d-7a48-490d-9529-8db0bce5e081","Type":"ContainerStarted","Data":"84bb1b8bc3946d8fd22029c2e8cabc2145762796f37e69c0d97ab989afc495ae"} Sep 09 23:24:51.938111 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.938076 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89c7e22d-7a48-490d-9529-8db0bce5e081","Type":"ContainerStarted","Data":"46187503e2da80f1fdda507d0469d5bae59234cd0331e1384c48f271af5a01f9"} Sep 09 23:24:51.938524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.938144 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89c7e22d-7a48-490d-9529-8db0bce5e081","Type":"ContainerStarted","Data":"5179f24b7c595ec6410ee2a4d47c91604813fd197e3e97aa632e7540c12aee2a"} Sep 09 23:24:51.938524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.938170 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89c7e22d-7a48-490d-9529-8db0bce5e081","Type":"ContainerStarted","Data":"6c43f89ed38cdff3ec977f2e1d5b79aa5c160aab1e8848f5e16e7d12fd559df3"} Sep 09 23:24:51.938524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.938195 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89c7e22d-7a48-490d-9529-8db0bce5e081","Type":"ContainerStarted","Data":"7e4adbb8dc97662ecbf2f40d9c6d17ec435d4cec111089c92c2592b9aa4fb55d"} Sep 09 23:24:51.938524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.938224 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89c7e22d-7a48-490d-9529-8db0bce5e081","Type":"ContainerStarted","Data":"806c35d2864912e000d5e3dc6aa7c545105db9a8b8140a3ea844eaef6dc2ba83"} Sep 09 23:24:51.938524 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.938248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89c7e22d-7a48-490d-9529-8db0bce5e081","Type":"ContainerStarted","Data":"77b1d93c984756467efc0497027ede3c46f67beccab3649903741b4ef902cd2d"} Sep 09 23:24:51.970287 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.970231 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.955924408 podStartE2EDuration="2.970213103s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.288695ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:24:51.968362559 +0000 UTC m=+146.261093143" watchObservedRunningTime="2026-09-09 23:24:51.970213103 +0000 UTC m=+146.262943668" Sep 09 23:24:51.989536 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.989501 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq"] Sep 09 23:24:51.991984 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.991961 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:51.994495 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.994473 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 09 23:24:51.994624 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.994476 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 09 23:24:51.994842 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.994821 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 09 23:24:51.994916 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.994857 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 09 23:24:51.994916 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.994905 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 09 23:24:51.995127 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:51.995112 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tjm96\"" Sep 09 23:24:52.004076 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.004050 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 09 23:24:52.009693 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.009667 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq"] Sep 09 23:24:52.158400 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.158363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2133527d-7602-4ddb-a7f2-cc5de484e551-serving-certs-ca-bundle\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.158400 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.158401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-federate-client-tls\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.158615 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.158494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2133527d-7602-4ddb-a7f2-cc5de484e551-metrics-client-ca\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.158615 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.158519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.158615 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.158556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbbzc\" (UniqueName: \"kubernetes.io/projected/2133527d-7602-4ddb-a7f2-cc5de484e551-kube-api-access-tbbzc\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.158615 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.158600 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-secret-telemeter-client\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.158748 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.158622 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-telemeter-client-tls\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.158748 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.158648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2133527d-7602-4ddb-a7f2-cc5de484e551-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.259672 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.259581 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2133527d-7602-4ddb-a7f2-cc5de484e551-metrics-client-ca\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.259672 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.259623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.259672 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.259644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbbzc\" (UniqueName: \"kubernetes.io/projected/2133527d-7602-4ddb-a7f2-cc5de484e551-kube-api-access-tbbzc\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.259931 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.259675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-secret-telemeter-client\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.259931 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.259691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-telemeter-client-tls\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.259931 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.259715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2133527d-7602-4ddb-a7f2-cc5de484e551-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.259931 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.259841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2133527d-7602-4ddb-a7f2-cc5de484e551-serving-certs-ca-bundle\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.259931 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.259882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-federate-client-tls\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.260538 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.260509 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2133527d-7602-4ddb-a7f2-cc5de484e551-metrics-client-ca\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.260726 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.260699 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2133527d-7602-4ddb-a7f2-cc5de484e551-serving-certs-ca-bundle\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.260800 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.260725 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2133527d-7602-4ddb-a7f2-cc5de484e551-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.262501 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.262478 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-federate-client-tls\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.262578 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.262478 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-telemeter-client-tls\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.262728 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.262709 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.262770 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.262728 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2133527d-7602-4ddb-a7f2-cc5de484e551-secret-telemeter-client\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.268514 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.268493 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbbzc\" (UniqueName: \"kubernetes.io/projected/2133527d-7602-4ddb-a7f2-cc5de484e551-kube-api-access-tbbzc\") pod \"telemeter-client-7cc5d9f758-gm2rq\" (UID: \"2133527d-7602-4ddb-a7f2-cc5de484e551\") " pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.307542 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.307503 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" Sep 09 23:24:52.595990 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.595964 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq"] Sep 09 23:24:52.597818 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:24:52.597778 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2133527d_7602_4ddb_a7f2_cc5de484e551.slice/crio-ededa860633ff257b9c02f1e36b9ffd4cea2293d3f14151b675d50908fdb1fa6 WatchSource:0}: Error finding container ededa860633ff257b9c02f1e36b9ffd4cea2293d3f14151b675d50908fdb1fa6: Status 404 returned error can't find the container with id ededa860633ff257b9c02f1e36b9ffd4cea2293d3f14151b675d50908fdb1fa6 Sep 09 23:24:52.944120 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:52.944030 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" event={"ID":"2133527d-7602-4ddb-a7f2-cc5de484e551","Type":"ContainerStarted","Data":"ededa860633ff257b9c02f1e36b9ffd4cea2293d3f14151b675d50908fdb1fa6"} Sep 09 23:24:54.958739 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:54.958692 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" event={"ID":"2133527d-7602-4ddb-a7f2-cc5de484e551","Type":"ContainerStarted","Data":"707139a12f94427c37fdae2872f44c5c8a03708a5a157608f4719ef535e80d56"} Sep 09 23:24:54.959220 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:54.958790 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" event={"ID":"2133527d-7602-4ddb-a7f2-cc5de484e551","Type":"ContainerStarted","Data":"f9a496d1d5509ea07b61639662765ce945ba4623db3812733238a07380659a4f"} Sep 09 23:24:54.959220 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:54.958810 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" event={"ID":"2133527d-7602-4ddb-a7f2-cc5de484e551","Type":"ContainerStarted","Data":"0cf6efb423c837dca76f134f26e3b2a01e93dfb8194b1abe4a1f34054441eff6"} Sep 09 23:24:54.982482 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:54.982424 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cc5d9f758-gm2rq" podStartSLOduration=2.350246272 podStartE2EDuration="3.98240827s" totalImagesPullingTime="1.632161998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:24:54.981232126 +0000 UTC m=+149.273962711" watchObservedRunningTime="2026-09-09 23:24:54.98240827 +0000 UTC m=+149.275138834" Sep 09 23:24:55.066510 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.066474 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f46d7978-qwvw8"] Sep 09 23:24:55.068733 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.068717 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.082428 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.082397 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f46d7978-qwvw8"] Sep 09 23:24:55.186410 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.186366 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-serving-cert\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.186410 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.186411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-console-config\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.186620 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.186431 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-trusted-ca-bundle\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.186620 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.186544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnkm2\" (UniqueName: \"kubernetes.io/projected/34a90213-b764-4285-a13e-cc29b3cd075a-kube-api-access-bnkm2\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.186620 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.186611 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-oauth-config\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.186715 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.186635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-service-ca\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.186715 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.186678 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-oauth-serving-cert\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.287850 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.287751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-oauth-config\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.287850 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.287789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-service-ca\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.287850 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.287822 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-oauth-serving-cert\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.287850 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.287849 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-serving-cert\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.288162 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.287866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-console-config\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.288162 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.287883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-trusted-ca-bundle\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.288162 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.287913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnkm2\" (UniqueName: \"kubernetes.io/projected/34a90213-b764-4285-a13e-cc29b3cd075a-kube-api-access-bnkm2\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.288698 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.288671 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-service-ca\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.288797 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.288699 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-oauth-serving-cert\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.288797 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.288777 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-console-config\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.289327 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.289278 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-trusted-ca-bundle\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.290341 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.290297 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-oauth-config\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.290465 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.290448 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-serving-cert\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.296232 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.296203 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnkm2\" (UniqueName: \"kubernetes.io/projected/34a90213-b764-4285-a13e-cc29b3cd075a-kube-api-access-bnkm2\") pod \"console-59f46d7978-qwvw8\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.377703 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.377650 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:24:55.652829 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.652793 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f46d7978-qwvw8"] Sep 09 23:24:55.655867 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:24:55.655837 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a90213_b764_4285_a13e_cc29b3cd075a.slice/crio-6bf84ed4e0b0ed7b9e09a98b447f56507a6a4659c223e17a346ef4b177c38b11 WatchSource:0}: Error finding container 6bf84ed4e0b0ed7b9e09a98b447f56507a6a4659c223e17a346ef4b177c38b11: Status 404 returned error can't find the container with id 6bf84ed4e0b0ed7b9e09a98b447f56507a6a4659c223e17a346ef4b177c38b11 Sep 09 23:24:55.963994 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.963904 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f46d7978-qwvw8" event={"ID":"34a90213-b764-4285-a13e-cc29b3cd075a","Type":"ContainerStarted","Data":"f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff"} Sep 09 23:24:55.963994 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.963970 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f46d7978-qwvw8" event={"ID":"34a90213-b764-4285-a13e-cc29b3cd075a","Type":"ContainerStarted","Data":"6bf84ed4e0b0ed7b9e09a98b447f56507a6a4659c223e17a346ef4b177c38b11"} Sep 09 23:24:55.984996 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:24:55.984942 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f46d7978-qwvw8" podStartSLOduration=0.984923711 podStartE2EDuration="984.923711ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:24:55.98383546 +0000 UTC m=+150.276566045" watchObservedRunningTime="2026-09-09 23:24:55.984923711 +0000 UTC m=+150.277654276" Sep 09 23:25:05.378754 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:05.378692 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:25:05.379169 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:05.378781 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:25:05.383665 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:05.383638 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:25:06.006084 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:06.006053 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:25:06.045792 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:06.045757 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d8c7ff5d4-9q78c"] Sep 09 23:25:31.065794 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.065744 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d8c7ff5d4-9q78c" podUID="9fd102b2-cfc1-4ed9-a14d-074c732fcd75" containerName="console" containerID="cri-o://a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7" gracePeriod=15 Sep 09 23:25:31.312072 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.312045 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:25:31.407608 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.407564 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-trusted-ca-bundle\") pod \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " Sep 09 23:25:31.407807 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.407620 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-config\") pod \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " Sep 09 23:25:31.407807 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.407649 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-oauth-config\") pod \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " Sep 09 23:25:31.407807 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.407703 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-serving-cert\") pod \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " Sep 09 23:25:31.407807 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.407749 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-oauth-serving-cert\") pod \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " Sep 09 23:25:31.407807 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.407780 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-service-ca\") pod \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " Sep 09 23:25:31.407807 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.407801 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5zmg\" (UniqueName: \"kubernetes.io/projected/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-kube-api-access-z5zmg\") pod \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\" (UID: \"9fd102b2-cfc1-4ed9-a14d-074c732fcd75\") " Sep 09 23:25:31.408113 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.408081 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9fd102b2-cfc1-4ed9-a14d-074c732fcd75" (UID: "9fd102b2-cfc1-4ed9-a14d-074c732fcd75"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:25:31.408216 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.408194 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-config" (OuterVolumeSpecName: "console-config") pod "9fd102b2-cfc1-4ed9-a14d-074c732fcd75" (UID: "9fd102b2-cfc1-4ed9-a14d-074c732fcd75"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:25:31.408273 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.408235 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9fd102b2-cfc1-4ed9-a14d-074c732fcd75" (UID: "9fd102b2-cfc1-4ed9-a14d-074c732fcd75"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:25:31.408273 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.408243 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-service-ca" (OuterVolumeSpecName: "service-ca") pod "9fd102b2-cfc1-4ed9-a14d-074c732fcd75" (UID: "9fd102b2-cfc1-4ed9-a14d-074c732fcd75"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:25:31.409860 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.409827 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9fd102b2-cfc1-4ed9-a14d-074c732fcd75" (UID: "9fd102b2-cfc1-4ed9-a14d-074c732fcd75"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:25:31.409966 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.409875 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9fd102b2-cfc1-4ed9-a14d-074c732fcd75" (UID: "9fd102b2-cfc1-4ed9-a14d-074c732fcd75"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:25:31.410002 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.409967 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-kube-api-access-z5zmg" (OuterVolumeSpecName: "kube-api-access-z5zmg") pod "9fd102b2-cfc1-4ed9-a14d-074c732fcd75" (UID: "9fd102b2-cfc1-4ed9-a14d-074c732fcd75"). InnerVolumeSpecName "kube-api-access-z5zmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:25:31.508754 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.508700 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-oauth-serving-cert\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:25:31.508754 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.508749 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-service-ca\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:25:31.508754 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.508760 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5zmg\" (UniqueName: \"kubernetes.io/projected/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-kube-api-access-z5zmg\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:25:31.508754 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.508771 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-trusted-ca-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:25:31.509005 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.508780 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-config\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:25:31.509005 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.508788 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-oauth-config\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:25:31.509005 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:31.508796 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fd102b2-cfc1-4ed9-a14d-074c732fcd75-console-serving-cert\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:25:32.102917 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:32.102882 2563 generic.go:356] "Generic (PLEG): container finished" podID="9fd102b2-cfc1-4ed9-a14d-074c732fcd75" containerID="a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7" exitCode=0 Sep 09 23:25:32.103370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:32.102925 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8c7ff5d4-9q78c" event={"ID":"9fd102b2-cfc1-4ed9-a14d-074c732fcd75","Type":"ContainerDied","Data":"a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7"} Sep 09 23:25:32.103370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:32.102931 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8c7ff5d4-9q78c" Sep 09 23:25:32.103370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:32.102964 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8c7ff5d4-9q78c" event={"ID":"9fd102b2-cfc1-4ed9-a14d-074c732fcd75","Type":"ContainerDied","Data":"1a3d91d53f0853fb652474dcf35ad6544fe7587abab4d6abe0d56f2a6e032e96"} Sep 09 23:25:32.103370 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:32.102983 2563 scope.go:117] "RemoveContainer" containerID="a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7" Sep 09 23:25:32.116080 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:32.116059 2563 scope.go:117] "RemoveContainer" containerID="a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7" Sep 09 23:25:32.116410 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:25:32.116376 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7\": container with ID starting with a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7 not found: ID does not exist" containerID="a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7" Sep 09 23:25:32.116480 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:32.116406 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7"} err="failed to get container status \"a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7\": rpc error: code = NotFound desc = could not find container \"a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7\": container with ID starting with a7d4562d7848636c7178aa5fb276089b535da895c731a227ff8d454565f4cdc7 not found: ID does not exist" Sep 09 23:25:32.125591 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:32.125567 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d8c7ff5d4-9q78c"] Sep 09 23:25:32.128916 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:32.128894 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d8c7ff5d4-9q78c"] Sep 09 23:25:32.191865 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:25:32.191830 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fd102b2-cfc1-4ed9-a14d-074c732fcd75" path="/var/lib/kubelet/pods/9fd102b2-cfc1-4ed9-a14d-074c732fcd75/volumes" Sep 09 23:26:30.874806 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.874773 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c97ccd68f-77b8p"] Sep 09 23:26:30.875193 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.875065 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fd102b2-cfc1-4ed9-a14d-074c732fcd75" containerName="console" Sep 09 23:26:30.875193 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.875076 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fd102b2-cfc1-4ed9-a14d-074c732fcd75" containerName="console" Sep 09 23:26:30.875193 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.875130 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fd102b2-cfc1-4ed9-a14d-074c732fcd75" containerName="console" Sep 09 23:26:30.879009 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.878988 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:30.892145 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.892116 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c97ccd68f-77b8p"] Sep 09 23:26:30.998889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.998846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-oauth-config\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:30.999063 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.998903 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-trusted-ca-bundle\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:30.999063 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.998930 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-oauth-serving-cert\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:30.999063 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.999002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-service-ca\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:30.999063 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.999041 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skxfw\" (UniqueName: \"kubernetes.io/projected/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-kube-api-access-skxfw\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:30.999192 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.999069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-serving-cert\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:30.999192 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:30.999155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-config\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.100117 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.100081 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-config\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.100117 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.100126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-oauth-config\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.100379 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.100250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-trusted-ca-bundle\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.100379 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.100281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-oauth-serving-cert\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.100379 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.100344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-service-ca\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.100379 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.100371 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skxfw\" (UniqueName: \"kubernetes.io/projected/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-kube-api-access-skxfw\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.100582 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.100479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-serving-cert\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.101031 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.101003 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-service-ca\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.101150 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.101040 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-oauth-serving-cert\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.101150 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.101040 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-config\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.101360 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.101339 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-trusted-ca-bundle\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.103158 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.103135 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-serving-cert\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.103232 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.103161 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-oauth-config\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.108353 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.108331 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skxfw\" (UniqueName: \"kubernetes.io/projected/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-kube-api-access-skxfw\") pod \"console-c97ccd68f-77b8p\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.189720 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.189624 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:31.466488 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:31.466407 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c97ccd68f-77b8p"] Sep 09 23:26:31.469692 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:26:31.469659 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17cca3e8_1247_4c9d_9e4d_84db407a8c2c.slice/crio-7af1496b74e7a28c5d88e581b6d4a3a5cd6ae3caaba71b1240d6852b06ee0b4a WatchSource:0}: Error finding container 7af1496b74e7a28c5d88e581b6d4a3a5cd6ae3caaba71b1240d6852b06ee0b4a: Status 404 returned error can't find the container with id 7af1496b74e7a28c5d88e581b6d4a3a5cd6ae3caaba71b1240d6852b06ee0b4a Sep 09 23:26:32.341777 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:32.341745 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c97ccd68f-77b8p" event={"ID":"17cca3e8-1247-4c9d-9e4d-84db407a8c2c","Type":"ContainerStarted","Data":"732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269"} Sep 09 23:26:32.342177 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:32.341792 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c97ccd68f-77b8p" event={"ID":"17cca3e8-1247-4c9d-9e4d-84db407a8c2c","Type":"ContainerStarted","Data":"7af1496b74e7a28c5d88e581b6d4a3a5cd6ae3caaba71b1240d6852b06ee0b4a"} Sep 09 23:26:32.359460 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:32.359408 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c97ccd68f-77b8p" podStartSLOduration=2.359389739 podStartE2EDuration="2.359389739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:26:32.358061412 +0000 UTC m=+246.650791988" watchObservedRunningTime="2026-09-09 23:26:32.359389739 +0000 UTC m=+246.652120303" Sep 09 23:26:41.190400 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:41.190359 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:41.190847 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:41.190422 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:41.195323 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:41.195286 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:41.384286 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:41.384259 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:26:41.427565 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:26:41.427517 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f46d7978-qwvw8"] Sep 09 23:27:04.196823 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.196759 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s"] Sep 09 23:27:04.200298 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.200277 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:04.202796 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.202775 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:27:04.203017 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.203000 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:27:04.203891 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.203876 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cqzxj\"" Sep 09 23:27:04.207297 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.207274 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s"] Sep 09 23:27:04.257934 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.257895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qclnq\" (UniqueName: \"kubernetes.io/projected/64c2c382-b6d8-46a0-ad4b-48f021164ed7-kube-api-access-qclnq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:04.258113 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.257952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:04.258113 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.257982 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:04.359265 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.359230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qclnq\" (UniqueName: \"kubernetes.io/projected/64c2c382-b6d8-46a0-ad4b-48f021164ed7-kube-api-access-qclnq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:04.359406 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.359275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:04.359406 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.359293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:04.359639 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.359622 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:04.359711 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.359694 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:04.367554 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.367526 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qclnq\" (UniqueName: \"kubernetes.io/projected/64c2c382-b6d8-46a0-ad4b-48f021164ed7-kube-api-access-qclnq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:04.511857 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.511761 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:04.781816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:04.781785 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s"] Sep 09 23:27:04.784210 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:27:04.784178 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c2c382_b6d8_46a0_ad4b_48f021164ed7.slice/crio-9a531e038ecf215b47e63315089d0527e97be21158a10306353060cd9d1bb926 WatchSource:0}: Error finding container 9a531e038ecf215b47e63315089d0527e97be21158a10306353060cd9d1bb926: Status 404 returned error can't find the container with id 9a531e038ecf215b47e63315089d0527e97be21158a10306353060cd9d1bb926 Sep 09 23:27:05.472293 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:05.472255 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" event={"ID":"64c2c382-b6d8-46a0-ad4b-48f021164ed7","Type":"ContainerStarted","Data":"9a531e038ecf215b47e63315089d0527e97be21158a10306353060cd9d1bb926"} Sep 09 23:27:06.447275 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.447233 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59f46d7978-qwvw8" podUID="34a90213-b764-4285-a13e-cc29b3cd075a" containerName="console" containerID="cri-o://f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff" gracePeriod=15 Sep 09 23:27:06.705369 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.705290 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:27:06.783394 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.783354 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-trusted-ca-bundle\") pod \"34a90213-b764-4285-a13e-cc29b3cd075a\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " Sep 09 23:27:06.783574 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.783467 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnkm2\" (UniqueName: \"kubernetes.io/projected/34a90213-b764-4285-a13e-cc29b3cd075a-kube-api-access-bnkm2\") pod \"34a90213-b764-4285-a13e-cc29b3cd075a\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " Sep 09 23:27:06.783574 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.783509 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-service-ca\") pod \"34a90213-b764-4285-a13e-cc29b3cd075a\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " Sep 09 23:27:06.783574 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.783546 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-serving-cert\") pod \"34a90213-b764-4285-a13e-cc29b3cd075a\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " Sep 09 23:27:06.783729 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.783596 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-oauth-serving-cert\") pod \"34a90213-b764-4285-a13e-cc29b3cd075a\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " Sep 09 23:27:06.783729 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.783629 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-oauth-config\") pod \"34a90213-b764-4285-a13e-cc29b3cd075a\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " Sep 09 23:27:06.783825 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.783761 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-console-config\") pod \"34a90213-b764-4285-a13e-cc29b3cd075a\" (UID: \"34a90213-b764-4285-a13e-cc29b3cd075a\") " Sep 09 23:27:06.784273 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.784239 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "34a90213-b764-4285-a13e-cc29b3cd075a" (UID: "34a90213-b764-4285-a13e-cc29b3cd075a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:27:06.784469 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.784351 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "34a90213-b764-4285-a13e-cc29b3cd075a" (UID: "34a90213-b764-4285-a13e-cc29b3cd075a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:27:06.784563 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.784362 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-service-ca" (OuterVolumeSpecName: "service-ca") pod "34a90213-b764-4285-a13e-cc29b3cd075a" (UID: "34a90213-b764-4285-a13e-cc29b3cd075a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:27:06.785073 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.785035 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-service-ca\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:06.785170 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.785073 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-oauth-serving-cert\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:06.785170 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.785089 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-trusted-ca-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:06.785274 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.785188 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-console-config" (OuterVolumeSpecName: "console-config") pod "34a90213-b764-4285-a13e-cc29b3cd075a" (UID: "34a90213-b764-4285-a13e-cc29b3cd075a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:27:06.792877 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.792288 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "34a90213-b764-4285-a13e-cc29b3cd075a" (UID: "34a90213-b764-4285-a13e-cc29b3cd075a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:27:06.792877 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.792424 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "34a90213-b764-4285-a13e-cc29b3cd075a" (UID: "34a90213-b764-4285-a13e-cc29b3cd075a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:27:06.794410 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.794296 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34a90213-b764-4285-a13e-cc29b3cd075a-kube-api-access-bnkm2" (OuterVolumeSpecName: "kube-api-access-bnkm2") pod "34a90213-b764-4285-a13e-cc29b3cd075a" (UID: "34a90213-b764-4285-a13e-cc29b3cd075a"). InnerVolumeSpecName "kube-api-access-bnkm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:27:06.886002 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.885962 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnkm2\" (UniqueName: \"kubernetes.io/projected/34a90213-b764-4285-a13e-cc29b3cd075a-kube-api-access-bnkm2\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:06.886002 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.886002 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-serving-cert\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:06.886204 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.886016 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34a90213-b764-4285-a13e-cc29b3cd075a-console-oauth-config\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:06.886204 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:06.886025 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34a90213-b764-4285-a13e-cc29b3cd075a-console-config\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:07.481670 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:07.481631 2563 generic.go:356] "Generic (PLEG): container finished" podID="34a90213-b764-4285-a13e-cc29b3cd075a" containerID="f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff" exitCode=0 Sep 09 23:27:07.481842 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:07.481696 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f46d7978-qwvw8" Sep 09 23:27:07.481842 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:07.481708 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f46d7978-qwvw8" event={"ID":"34a90213-b764-4285-a13e-cc29b3cd075a","Type":"ContainerDied","Data":"f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff"} Sep 09 23:27:07.481842 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:07.481770 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f46d7978-qwvw8" event={"ID":"34a90213-b764-4285-a13e-cc29b3cd075a","Type":"ContainerDied","Data":"6bf84ed4e0b0ed7b9e09a98b447f56507a6a4659c223e17a346ef4b177c38b11"} Sep 09 23:27:07.481842 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:07.481792 2563 scope.go:117] "RemoveContainer" containerID="f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff" Sep 09 23:27:07.490044 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:07.490018 2563 scope.go:117] "RemoveContainer" containerID="f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff" Sep 09 23:27:07.490352 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:27:07.490332 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff\": container with ID starting with f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff not found: ID does not exist" containerID="f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff" Sep 09 23:27:07.490410 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:07.490361 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff"} err="failed to get container status \"f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff\": rpc error: code = NotFound desc = could not find container \"f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff\": container with ID starting with f079096feee40aeeeb03b8ca864abc36b4b8c4cbd44cdae90b697192413b2dff not found: ID does not exist" Sep 09 23:27:07.501157 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:07.501129 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f46d7978-qwvw8"] Sep 09 23:27:07.504188 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:07.504163 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59f46d7978-qwvw8"] Sep 09 23:27:08.192864 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:08.192828 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34a90213-b764-4285-a13e-cc29b3cd075a" path="/var/lib/kubelet/pods/34a90213-b764-4285-a13e-cc29b3cd075a/volumes" Sep 09 23:27:11.502406 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:11.502369 2563 generic.go:356] "Generic (PLEG): container finished" podID="64c2c382-b6d8-46a0-ad4b-48f021164ed7" containerID="3e06b540d0558beb13fc147d6fa4b580a6f32d695d4d3385e5939c2fbc3bd319" exitCode=0 Sep 09 23:27:11.502882 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:11.502457 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" event={"ID":"64c2c382-b6d8-46a0-ad4b-48f021164ed7","Type":"ContainerDied","Data":"3e06b540d0558beb13fc147d6fa4b580a6f32d695d4d3385e5939c2fbc3bd319"} Sep 09 23:27:13.512731 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:13.512696 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" event={"ID":"64c2c382-b6d8-46a0-ad4b-48f021164ed7","Type":"ContainerStarted","Data":"c3f309db1557dd26a50dd1e4ab0e5ff71b7eb90d37dc858d7dd5875400428f9f"} Sep 09 23:27:14.518582 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:14.518542 2563 generic.go:356] "Generic (PLEG): container finished" podID="64c2c382-b6d8-46a0-ad4b-48f021164ed7" containerID="c3f309db1557dd26a50dd1e4ab0e5ff71b7eb90d37dc858d7dd5875400428f9f" exitCode=0 Sep 09 23:27:14.518582 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:14.518578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" event={"ID":"64c2c382-b6d8-46a0-ad4b-48f021164ed7","Type":"ContainerDied","Data":"c3f309db1557dd26a50dd1e4ab0e5ff71b7eb90d37dc858d7dd5875400428f9f"} Sep 09 23:27:22.557295 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:22.557257 2563 generic.go:356] "Generic (PLEG): container finished" podID="64c2c382-b6d8-46a0-ad4b-48f021164ed7" containerID="2d86262d26bd34fbb5a705df161e35982f40c93eae3648149cb7cf7957f5ff2b" exitCode=0 Sep 09 23:27:22.557675 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:22.557340 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" event={"ID":"64c2c382-b6d8-46a0-ad4b-48f021164ed7","Type":"ContainerDied","Data":"2d86262d26bd34fbb5a705df161e35982f40c93eae3648149cb7cf7957f5ff2b"} Sep 09 23:27:23.682418 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:23.682394 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:23.843931 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:23.843898 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-bundle\") pod \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " Sep 09 23:27:23.844110 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:23.843946 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-util\") pod \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " Sep 09 23:27:23.844110 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:23.843995 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qclnq\" (UniqueName: \"kubernetes.io/projected/64c2c382-b6d8-46a0-ad4b-48f021164ed7-kube-api-access-qclnq\") pod \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\" (UID: \"64c2c382-b6d8-46a0-ad4b-48f021164ed7\") " Sep 09 23:27:23.844622 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:23.844588 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-bundle" (OuterVolumeSpecName: "bundle") pod "64c2c382-b6d8-46a0-ad4b-48f021164ed7" (UID: "64c2c382-b6d8-46a0-ad4b-48f021164ed7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:27:23.846130 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:23.846105 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c2c382-b6d8-46a0-ad4b-48f021164ed7-kube-api-access-qclnq" (OuterVolumeSpecName: "kube-api-access-qclnq") pod "64c2c382-b6d8-46a0-ad4b-48f021164ed7" (UID: "64c2c382-b6d8-46a0-ad4b-48f021164ed7"). InnerVolumeSpecName "kube-api-access-qclnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:27:23.849158 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:23.849130 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-util" (OuterVolumeSpecName: "util") pod "64c2c382-b6d8-46a0-ad4b-48f021164ed7" (UID: "64c2c382-b6d8-46a0-ad4b-48f021164ed7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:27:23.945327 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:23.945260 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qclnq\" (UniqueName: \"kubernetes.io/projected/64c2c382-b6d8-46a0-ad4b-48f021164ed7-kube-api-access-qclnq\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:23.945327 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:23.945300 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:23.945327 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:23.945336 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c2c382-b6d8-46a0-ad4b-48f021164ed7-util\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:24.568466 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:24.568433 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" event={"ID":"64c2c382-b6d8-46a0-ad4b-48f021164ed7","Type":"ContainerDied","Data":"9a531e038ecf215b47e63315089d0527e97be21158a10306353060cd9d1bb926"} Sep 09 23:27:24.568624 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:24.568480 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nqx9s" Sep 09 23:27:24.568624 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:24.568485 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a531e038ecf215b47e63315089d0527e97be21158a10306353060cd9d1bb926" Sep 09 23:27:26.077928 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:26.077901 2563 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 23:27:32.184146 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.184110 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg"] Sep 09 23:27:32.185628 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.184407 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64c2c382-b6d8-46a0-ad4b-48f021164ed7" containerName="extract" Sep 09 23:27:32.185628 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.184418 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64c2c382-b6d8-46a0-ad4b-48f021164ed7" containerName="extract" Sep 09 23:27:32.185628 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.184426 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64c2c382-b6d8-46a0-ad4b-48f021164ed7" containerName="pull" Sep 09 23:27:32.185628 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.184432 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64c2c382-b6d8-46a0-ad4b-48f021164ed7" containerName="pull" Sep 09 23:27:32.185628 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.184443 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34a90213-b764-4285-a13e-cc29b3cd075a" containerName="console" Sep 09 23:27:32.185628 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.184448 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="34a90213-b764-4285-a13e-cc29b3cd075a" containerName="console" Sep 09 23:27:32.185628 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.184455 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64c2c382-b6d8-46a0-ad4b-48f021164ed7" containerName="util" Sep 09 23:27:32.185628 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.184460 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64c2c382-b6d8-46a0-ad4b-48f021164ed7" containerName="util" Sep 09 23:27:32.185628 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.184512 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="34a90213-b764-4285-a13e-cc29b3cd075a" containerName="console" Sep 09 23:27:32.185628 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.184520 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="64c2c382-b6d8-46a0-ad4b-48f021164ed7" containerName="extract" Sep 09 23:27:32.186272 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.186255 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg" Sep 09 23:27:32.189107 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.189083 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ssqwf\"" Sep 09 23:27:32.189246 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.189152 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 09 23:27:32.189348 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.189255 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:27:32.198716 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.198694 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg"] Sep 09 23:27:32.212807 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.212777 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrlx2\" (UniqueName: \"kubernetes.io/projected/cc292f65-62ea-447d-a9ad-0206e45a03ee-kube-api-access-jrlx2\") pod \"cert-manager-operator-controller-manager-55c444bf86-nqspg\" (UID: \"cc292f65-62ea-447d-a9ad-0206e45a03ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg" Sep 09 23:27:32.212945 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.212830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc292f65-62ea-447d-a9ad-0206e45a03ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nqspg\" (UID: \"cc292f65-62ea-447d-a9ad-0206e45a03ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg" Sep 09 23:27:32.313758 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.313716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrlx2\" (UniqueName: \"kubernetes.io/projected/cc292f65-62ea-447d-a9ad-0206e45a03ee-kube-api-access-jrlx2\") pod \"cert-manager-operator-controller-manager-55c444bf86-nqspg\" (UID: \"cc292f65-62ea-447d-a9ad-0206e45a03ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg" Sep 09 23:27:32.313931 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.313766 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc292f65-62ea-447d-a9ad-0206e45a03ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nqspg\" (UID: \"cc292f65-62ea-447d-a9ad-0206e45a03ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg" Sep 09 23:27:32.314216 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.314196 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc292f65-62ea-447d-a9ad-0206e45a03ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nqspg\" (UID: \"cc292f65-62ea-447d-a9ad-0206e45a03ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg" Sep 09 23:27:32.322381 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.322352 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrlx2\" (UniqueName: \"kubernetes.io/projected/cc292f65-62ea-447d-a9ad-0206e45a03ee-kube-api-access-jrlx2\") pod \"cert-manager-operator-controller-manager-55c444bf86-nqspg\" (UID: \"cc292f65-62ea-447d-a9ad-0206e45a03ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg" Sep 09 23:27:32.495391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.495289 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg" Sep 09 23:27:32.772365 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.772336 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg"] Sep 09 23:27:32.774120 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:27:32.774090 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc292f65_62ea_447d_a9ad_0206e45a03ee.slice/crio-743340b42ed3a2ed49911bdfa6398067b8e400fecdcfb2955d4d6afb0d6c2188 WatchSource:0}: Error finding container 743340b42ed3a2ed49911bdfa6398067b8e400fecdcfb2955d4d6afb0d6c2188: Status 404 returned error can't find the container with id 743340b42ed3a2ed49911bdfa6398067b8e400fecdcfb2955d4d6afb0d6c2188 Sep 09 23:27:32.776986 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:32.776969 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:27:33.605674 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:33.605641 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg" event={"ID":"cc292f65-62ea-447d-a9ad-0206e45a03ee","Type":"ContainerStarted","Data":"743340b42ed3a2ed49911bdfa6398067b8e400fecdcfb2955d4d6afb0d6c2188"} Sep 09 23:27:34.612387 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:34.612338 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg" event={"ID":"cc292f65-62ea-447d-a9ad-0206e45a03ee","Type":"ContainerStarted","Data":"54b4200fdd72b10434311df267f9a2b88d6feba4c7a6cedf3c1d0ad8e31777e4"} Sep 09 23:27:35.867398 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:35.867333 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nqspg" podStartSLOduration=2.236490398 podStartE2EDuration="3.867293644s" totalImagesPullingTime="1.630803246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:27:34.637086497 +0000 UTC m=+308.929817061" watchObservedRunningTime="2026-09-09 23:27:35.867293644 +0000 UTC m=+310.160024222" Sep 09 23:27:35.867782 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:35.867509 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf"] Sep 09 23:27:35.869809 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:35.869792 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:35.872405 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:35.872379 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:27:35.872545 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:35.872466 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:27:35.873361 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:35.873341 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cqzxj\"" Sep 09 23:27:35.880924 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:35.880902 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf"] Sep 09 23:27:35.940046 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:35.940010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:35.940222 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:35.940069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:35.940222 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:35.940111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7vt4\" (UniqueName: \"kubernetes.io/projected/c0b2f245-5a39-41cd-a2c3-b9f75947e984-kube-api-access-m7vt4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:36.040505 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:36.040470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:36.040505 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:36.040521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:36.040757 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:36.040551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7vt4\" (UniqueName: \"kubernetes.io/projected/c0b2f245-5a39-41cd-a2c3-b9f75947e984-kube-api-access-m7vt4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:36.040925 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:36.040903 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:36.040993 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:36.040922 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:36.048409 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:36.048373 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7vt4\" (UniqueName: \"kubernetes.io/projected/c0b2f245-5a39-41cd-a2c3-b9f75947e984-kube-api-access-m7vt4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:36.178303 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:36.178202 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:36.453092 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:36.453065 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf"] Sep 09 23:27:36.455545 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:27:36.455512 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b2f245_5a39_41cd_a2c3_b9f75947e984.slice/crio-25eb0eacd5f99192da0557d600f2b1470ed52c81fd85a1f6c4de1bbad97e278c WatchSource:0}: Error finding container 25eb0eacd5f99192da0557d600f2b1470ed52c81fd85a1f6c4de1bbad97e278c: Status 404 returned error can't find the container with id 25eb0eacd5f99192da0557d600f2b1470ed52c81fd85a1f6c4de1bbad97e278c Sep 09 23:27:36.623645 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:36.623606 2563 generic.go:356] "Generic (PLEG): container finished" podID="c0b2f245-5a39-41cd-a2c3-b9f75947e984" containerID="7e5f7a43e9bc48f75a0983588c2b9d5aeb9503469a540f1f7a14f1dba9e60749" exitCode=0 Sep 09 23:27:36.623816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:36.623697 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" event={"ID":"c0b2f245-5a39-41cd-a2c3-b9f75947e984","Type":"ContainerDied","Data":"7e5f7a43e9bc48f75a0983588c2b9d5aeb9503469a540f1f7a14f1dba9e60749"} Sep 09 23:27:36.623816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:36.623747 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" event={"ID":"c0b2f245-5a39-41cd-a2c3-b9f75947e984","Type":"ContainerStarted","Data":"25eb0eacd5f99192da0557d600f2b1470ed52c81fd85a1f6c4de1bbad97e278c"} Sep 09 23:27:38.641246 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:38.641204 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" event={"ID":"c0b2f245-5a39-41cd-a2c3-b9f75947e984","Type":"ContainerStarted","Data":"f89cc35b2990581d171341e5a184a93c4caac89f0604c56c2e77819d2cc94549"} Sep 09 23:27:39.647757 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:39.647719 2563 generic.go:356] "Generic (PLEG): container finished" podID="c0b2f245-5a39-41cd-a2c3-b9f75947e984" containerID="f89cc35b2990581d171341e5a184a93c4caac89f0604c56c2e77819d2cc94549" exitCode=0 Sep 09 23:27:39.648142 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:39.647793 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" event={"ID":"c0b2f245-5a39-41cd-a2c3-b9f75947e984","Type":"ContainerDied","Data":"f89cc35b2990581d171341e5a184a93c4caac89f0604c56c2e77819d2cc94549"} Sep 09 23:27:40.655821 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:40.655785 2563 generic.go:356] "Generic (PLEG): container finished" podID="c0b2f245-5a39-41cd-a2c3-b9f75947e984" containerID="36908642ac8184657573785a8772b2ae1cce48a6946b6fa77e917efeace45427" exitCode=0 Sep 09 23:27:40.656221 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:40.655831 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" event={"ID":"c0b2f245-5a39-41cd-a2c3-b9f75947e984","Type":"ContainerDied","Data":"36908642ac8184657573785a8772b2ae1cce48a6946b6fa77e917efeace45427"} Sep 09 23:27:41.782568 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:41.782544 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:41.879567 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:41.879525 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-util\") pod \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " Sep 09 23:27:41.879738 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:41.879582 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7vt4\" (UniqueName: \"kubernetes.io/projected/c0b2f245-5a39-41cd-a2c3-b9f75947e984-kube-api-access-m7vt4\") pod \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " Sep 09 23:27:41.879738 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:41.879601 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-bundle\") pod \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\" (UID: \"c0b2f245-5a39-41cd-a2c3-b9f75947e984\") " Sep 09 23:27:41.880075 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:41.880039 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-bundle" (OuterVolumeSpecName: "bundle") pod "c0b2f245-5a39-41cd-a2c3-b9f75947e984" (UID: "c0b2f245-5a39-41cd-a2c3-b9f75947e984"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:27:41.881703 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:41.881675 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b2f245-5a39-41cd-a2c3-b9f75947e984-kube-api-access-m7vt4" (OuterVolumeSpecName: "kube-api-access-m7vt4") pod "c0b2f245-5a39-41cd-a2c3-b9f75947e984" (UID: "c0b2f245-5a39-41cd-a2c3-b9f75947e984"). InnerVolumeSpecName "kube-api-access-m7vt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:27:41.947723 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:41.947636 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-util" (OuterVolumeSpecName: "util") pod "c0b2f245-5a39-41cd-a2c3-b9f75947e984" (UID: "c0b2f245-5a39-41cd-a2c3-b9f75947e984"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:27:41.980399 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:41.980357 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-util\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:41.980399 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:41.980396 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7vt4\" (UniqueName: \"kubernetes.io/projected/c0b2f245-5a39-41cd-a2c3-b9f75947e984-kube-api-access-m7vt4\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:41.980560 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:41.980406 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b2f245-5a39-41cd-a2c3-b9f75947e984-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:27:42.667396 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:42.667348 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" event={"ID":"c0b2f245-5a39-41cd-a2c3-b9f75947e984","Type":"ContainerDied","Data":"25eb0eacd5f99192da0557d600f2b1470ed52c81fd85a1f6c4de1bbad97e278c"} Sep 09 23:27:42.667563 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:42.667415 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25eb0eacd5f99192da0557d600f2b1470ed52c81fd85a1f6c4de1bbad97e278c" Sep 09 23:27:42.667563 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:42.667365 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frwjwf" Sep 09 23:27:44.275753 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.275721 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-npncw"] Sep 09 23:27:44.276135 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.276013 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b2f245-5a39-41cd-a2c3-b9f75947e984" containerName="pull" Sep 09 23:27:44.276135 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.276023 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b2f245-5a39-41cd-a2c3-b9f75947e984" containerName="pull" Sep 09 23:27:44.276135 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.276040 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b2f245-5a39-41cd-a2c3-b9f75947e984" containerName="util" Sep 09 23:27:44.276135 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.276045 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b2f245-5a39-41cd-a2c3-b9f75947e984" containerName="util" Sep 09 23:27:44.276135 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.276056 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b2f245-5a39-41cd-a2c3-b9f75947e984" containerName="extract" Sep 09 23:27:44.276135 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.276062 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b2f245-5a39-41cd-a2c3-b9f75947e984" containerName="extract" Sep 09 23:27:44.276135 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.276103 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b2f245-5a39-41cd-a2c3-b9f75947e984" containerName="extract" Sep 09 23:27:44.280341 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.280324 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-npncw" Sep 09 23:27:44.282796 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.282771 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ndqrk\"" Sep 09 23:27:44.283052 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.283035 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 23:27:44.283738 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.283718 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 23:27:44.286322 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.286285 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-npncw"] Sep 09 23:27:44.299399 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.299365 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84h7v\" (UniqueName: \"kubernetes.io/projected/c92943b5-9a74-4db7-a238-9908be5ddb03-kube-api-access-84h7v\") pod \"cert-manager-cainjector-559cdd8c87-npncw\" (UID: \"c92943b5-9a74-4db7-a238-9908be5ddb03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-npncw" Sep 09 23:27:44.299529 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.299507 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c92943b5-9a74-4db7-a238-9908be5ddb03-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-npncw\" (UID: \"c92943b5-9a74-4db7-a238-9908be5ddb03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-npncw" Sep 09 23:27:44.400271 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.400234 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84h7v\" (UniqueName: \"kubernetes.io/projected/c92943b5-9a74-4db7-a238-9908be5ddb03-kube-api-access-84h7v\") pod \"cert-manager-cainjector-559cdd8c87-npncw\" (UID: \"c92943b5-9a74-4db7-a238-9908be5ddb03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-npncw" Sep 09 23:27:44.400443 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.400382 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c92943b5-9a74-4db7-a238-9908be5ddb03-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-npncw\" (UID: \"c92943b5-9a74-4db7-a238-9908be5ddb03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-npncw" Sep 09 23:27:44.408551 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.408525 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c92943b5-9a74-4db7-a238-9908be5ddb03-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-npncw\" (UID: \"c92943b5-9a74-4db7-a238-9908be5ddb03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-npncw" Sep 09 23:27:44.408882 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.408855 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84h7v\" (UniqueName: \"kubernetes.io/projected/c92943b5-9a74-4db7-a238-9908be5ddb03-kube-api-access-84h7v\") pod \"cert-manager-cainjector-559cdd8c87-npncw\" (UID: \"c92943b5-9a74-4db7-a238-9908be5ddb03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-npncw" Sep 09 23:27:44.598409 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.598377 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-npncw" Sep 09 23:27:44.870000 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:44.869876 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-npncw"] Sep 09 23:27:44.872727 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:27:44.872694 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc92943b5_9a74_4db7_a238_9908be5ddb03.slice/crio-34df0b238900aa57bdf8dac13f73b288460a224e7f910565636f24065686c34c WatchSource:0}: Error finding container 34df0b238900aa57bdf8dac13f73b288460a224e7f910565636f24065686c34c: Status 404 returned error can't find the container with id 34df0b238900aa57bdf8dac13f73b288460a224e7f910565636f24065686c34c Sep 09 23:27:45.687886 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:45.687842 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-npncw" event={"ID":"c92943b5-9a74-4db7-a238-9908be5ddb03","Type":"ContainerStarted","Data":"34df0b238900aa57bdf8dac13f73b288460a224e7f910565636f24065686c34c"} Sep 09 23:27:46.754496 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:46.754458 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rx9n2"] Sep 09 23:27:46.758428 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:46.758402 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rx9n2" Sep 09 23:27:46.760890 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:46.760871 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-82lln\"" Sep 09 23:27:46.767793 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:46.767766 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rx9n2"] Sep 09 23:27:46.823555 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:46.823514 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9577e14f-927a-46c5-ab58-5ad50f58f7b4-bound-sa-token\") pod \"cert-manager-55b4d954d5-rx9n2\" (UID: \"9577e14f-927a-46c5-ab58-5ad50f58f7b4\") " pod="cert-manager/cert-manager-55b4d954d5-rx9n2" Sep 09 23:27:46.823745 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:46.823645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz42s\" (UniqueName: \"kubernetes.io/projected/9577e14f-927a-46c5-ab58-5ad50f58f7b4-kube-api-access-hz42s\") pod \"cert-manager-55b4d954d5-rx9n2\" (UID: \"9577e14f-927a-46c5-ab58-5ad50f58f7b4\") " pod="cert-manager/cert-manager-55b4d954d5-rx9n2" Sep 09 23:27:46.924827 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:46.924785 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz42s\" (UniqueName: \"kubernetes.io/projected/9577e14f-927a-46c5-ab58-5ad50f58f7b4-kube-api-access-hz42s\") pod \"cert-manager-55b4d954d5-rx9n2\" (UID: \"9577e14f-927a-46c5-ab58-5ad50f58f7b4\") " pod="cert-manager/cert-manager-55b4d954d5-rx9n2" Sep 09 23:27:46.924995 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:46.924891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9577e14f-927a-46c5-ab58-5ad50f58f7b4-bound-sa-token\") pod \"cert-manager-55b4d954d5-rx9n2\" (UID: \"9577e14f-927a-46c5-ab58-5ad50f58f7b4\") " pod="cert-manager/cert-manager-55b4d954d5-rx9n2" Sep 09 23:27:46.934191 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:46.934160 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9577e14f-927a-46c5-ab58-5ad50f58f7b4-bound-sa-token\") pod \"cert-manager-55b4d954d5-rx9n2\" (UID: \"9577e14f-927a-46c5-ab58-5ad50f58f7b4\") " pod="cert-manager/cert-manager-55b4d954d5-rx9n2" Sep 09 23:27:46.934397 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:46.934373 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz42s\" (UniqueName: \"kubernetes.io/projected/9577e14f-927a-46c5-ab58-5ad50f58f7b4-kube-api-access-hz42s\") pod \"cert-manager-55b4d954d5-rx9n2\" (UID: \"9577e14f-927a-46c5-ab58-5ad50f58f7b4\") " pod="cert-manager/cert-manager-55b4d954d5-rx9n2" Sep 09 23:27:47.070650 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:47.070613 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rx9n2" Sep 09 23:27:47.698945 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:47.698911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-npncw" event={"ID":"c92943b5-9a74-4db7-a238-9908be5ddb03","Type":"ContainerStarted","Data":"c93ca4da4bc53a13ad1d7b9e8785eafd9ad621e930739ba880c2296370cf8ab2"} Sep 09 23:27:47.714142 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:47.714090 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-npncw" podStartSLOduration=0.992137273 podStartE2EDuration="3.714072924s" totalImagesPullingTime="2.721935651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:27:47.713585997 +0000 UTC m=+322.006316565" watchObservedRunningTime="2026-09-09 23:27:47.714072924 +0000 UTC m=+322.006803489" Sep 09 23:27:47.800671 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:47.800590 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rx9n2"] Sep 09 23:27:47.803680 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:27:47.803652 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9577e14f_927a_46c5_ab58_5ad50f58f7b4.slice/crio-97a8bdf71a743f547c0b239e473a1c5b6979c763b268fc7cbec79f700a5a5ac6 WatchSource:0}: Error finding container 97a8bdf71a743f547c0b239e473a1c5b6979c763b268fc7cbec79f700a5a5ac6: Status 404 returned error can't find the container with id 97a8bdf71a743f547c0b239e473a1c5b6979c763b268fc7cbec79f700a5a5ac6 Sep 09 23:27:48.705479 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:48.705428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rx9n2" event={"ID":"9577e14f-927a-46c5-ab58-5ad50f58f7b4","Type":"ContainerStarted","Data":"a4854534361009a5906c6861c74bf5469d5edbe3ee344755c7aae48c5e2367e3"} Sep 09 23:27:48.705642 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:48.705487 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rx9n2" event={"ID":"9577e14f-927a-46c5-ab58-5ad50f58f7b4","Type":"ContainerStarted","Data":"97a8bdf71a743f547c0b239e473a1c5b6979c763b268fc7cbec79f700a5a5ac6"} Sep 09 23:27:48.722789 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:48.722736 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rx9n2" podStartSLOduration=2.722720126 podStartE2EDuration="2.722720126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:27:48.721560776 +0000 UTC m=+323.014291362" watchObservedRunningTime="2026-09-09 23:27:48.722720126 +0000 UTC m=+323.015450691" Sep 09 23:27:56.024660 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.024620 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr"] Sep 09 23:27:56.046398 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.046360 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr"] Sep 09 23:27:56.046543 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.046484 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:27:56.049285 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.049252 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cqzxj\"" Sep 09 23:27:56.049285 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.049252 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:27:56.050218 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.050197 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:27:56.098219 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.098178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:27:56.098444 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.098255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:27:56.098444 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.098353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtn5g\" (UniqueName: \"kubernetes.io/projected/726ec2c1-0a01-4681-9897-d604b5c59b73-kube-api-access-xtn5g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:27:56.198863 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.198832 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:27:56.199035 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.198885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtn5g\" (UniqueName: \"kubernetes.io/projected/726ec2c1-0a01-4681-9897-d604b5c59b73-kube-api-access-xtn5g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:27:56.199035 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.198934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:27:56.199280 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.199254 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:27:56.199280 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.199275 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:27:56.206664 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.206641 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtn5g\" (UniqueName: \"kubernetes.io/projected/726ec2c1-0a01-4681-9897-d604b5c59b73-kube-api-access-xtn5g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:27:56.356300 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.356268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:27:56.651465 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.651419 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr"] Sep 09 23:27:56.653915 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:27:56.653887 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726ec2c1_0a01_4681_9897_d604b5c59b73.slice/crio-d5e6541c5fb7dee03c7ea57059e24d5a794ba9a0bb2b562e04f73fc62bfb7cba WatchSource:0}: Error finding container d5e6541c5fb7dee03c7ea57059e24d5a794ba9a0bb2b562e04f73fc62bfb7cba: Status 404 returned error can't find the container with id d5e6541c5fb7dee03c7ea57059e24d5a794ba9a0bb2b562e04f73fc62bfb7cba Sep 09 23:27:56.740879 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:56.740848 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" event={"ID":"726ec2c1-0a01-4681-9897-d604b5c59b73","Type":"ContainerStarted","Data":"d5e6541c5fb7dee03c7ea57059e24d5a794ba9a0bb2b562e04f73fc62bfb7cba"} Sep 09 23:27:57.747004 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:57.746966 2563 generic.go:356] "Generic (PLEG): container finished" podID="726ec2c1-0a01-4681-9897-d604b5c59b73" containerID="babeee7b06a15bd4fbcba07a089fd933a934ae29049286f5b6e56f3ac678bd0a" exitCode=0 Sep 09 23:27:57.747483 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:57.747055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" event={"ID":"726ec2c1-0a01-4681-9897-d604b5c59b73","Type":"ContainerDied","Data":"babeee7b06a15bd4fbcba07a089fd933a934ae29049286f5b6e56f3ac678bd0a"} Sep 09 23:27:58.753292 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:58.753207 2563 generic.go:356] "Generic (PLEG): container finished" podID="726ec2c1-0a01-4681-9897-d604b5c59b73" containerID="bfdd450d831550c05705107f7e367142b07230918f80a6d0855351af3037621f" exitCode=0 Sep 09 23:27:58.753292 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:58.753283 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" event={"ID":"726ec2c1-0a01-4681-9897-d604b5c59b73","Type":"ContainerDied","Data":"bfdd450d831550c05705107f7e367142b07230918f80a6d0855351af3037621f"} Sep 09 23:27:59.765375 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:59.765338 2563 generic.go:356] "Generic (PLEG): container finished" podID="726ec2c1-0a01-4681-9897-d604b5c59b73" containerID="7a966d5be8369403c1e4cf155d264afa98322df5b2edd7f10bfbed125a56632f" exitCode=0 Sep 09 23:27:59.765816 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:27:59.765451 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" event={"ID":"726ec2c1-0a01-4681-9897-d604b5c59b73","Type":"ContainerDied","Data":"7a966d5be8369403c1e4cf155d264afa98322df5b2edd7f10bfbed125a56632f"} Sep 09 23:28:00.894512 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:00.894486 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:28:00.935415 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:00.935379 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-bundle\") pod \"726ec2c1-0a01-4681-9897-d604b5c59b73\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " Sep 09 23:28:00.935546 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:00.935469 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-util\") pod \"726ec2c1-0a01-4681-9897-d604b5c59b73\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " Sep 09 23:28:00.935546 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:00.935494 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtn5g\" (UniqueName: \"kubernetes.io/projected/726ec2c1-0a01-4681-9897-d604b5c59b73-kube-api-access-xtn5g\") pod \"726ec2c1-0a01-4681-9897-d604b5c59b73\" (UID: \"726ec2c1-0a01-4681-9897-d604b5c59b73\") " Sep 09 23:28:00.936131 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:00.936101 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-bundle" (OuterVolumeSpecName: "bundle") pod "726ec2c1-0a01-4681-9897-d604b5c59b73" (UID: "726ec2c1-0a01-4681-9897-d604b5c59b73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:28:00.937571 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:00.937547 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/726ec2c1-0a01-4681-9897-d604b5c59b73-kube-api-access-xtn5g" (OuterVolumeSpecName: "kube-api-access-xtn5g") pod "726ec2c1-0a01-4681-9897-d604b5c59b73" (UID: "726ec2c1-0a01-4681-9897-d604b5c59b73"). InnerVolumeSpecName "kube-api-access-xtn5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:28:00.941009 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:00.940982 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-util" (OuterVolumeSpecName: "util") pod "726ec2c1-0a01-4681-9897-d604b5c59b73" (UID: "726ec2c1-0a01-4681-9897-d604b5c59b73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:28:01.037039 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:01.036960 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:28:01.037039 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:01.036986 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726ec2c1-0a01-4681-9897-d604b5c59b73-util\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:28:01.037039 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:01.036996 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtn5g\" (UniqueName: \"kubernetes.io/projected/726ec2c1-0a01-4681-9897-d604b5c59b73-kube-api-access-xtn5g\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:28:01.777178 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:01.777141 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" event={"ID":"726ec2c1-0a01-4681-9897-d604b5c59b73","Type":"ContainerDied","Data":"d5e6541c5fb7dee03c7ea57059e24d5a794ba9a0bb2b562e04f73fc62bfb7cba"} Sep 09 23:28:01.777373 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:01.777195 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5e6541c5fb7dee03c7ea57059e24d5a794ba9a0bb2b562e04f73fc62bfb7cba" Sep 09 23:28:01.777373 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:01.777157 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bgtr" Sep 09 23:28:06.845399 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.845363 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl"] Sep 09 23:28:06.845759 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.845684 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726ec2c1-0a01-4681-9897-d604b5c59b73" containerName="util" Sep 09 23:28:06.845759 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.845696 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="726ec2c1-0a01-4681-9897-d604b5c59b73" containerName="util" Sep 09 23:28:06.845759 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.845705 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726ec2c1-0a01-4681-9897-d604b5c59b73" containerName="extract" Sep 09 23:28:06.845759 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.845710 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="726ec2c1-0a01-4681-9897-d604b5c59b73" containerName="extract" Sep 09 23:28:06.845759 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.845727 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726ec2c1-0a01-4681-9897-d604b5c59b73" containerName="pull" Sep 09 23:28:06.845759 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.845736 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="726ec2c1-0a01-4681-9897-d604b5c59b73" containerName="pull" Sep 09 23:28:06.845936 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.845786 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="726ec2c1-0a01-4681-9897-d604b5c59b73" containerName="extract" Sep 09 23:28:06.848002 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.847984 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:06.850416 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.850394 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:28:06.851285 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.851265 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cqzxj\"" Sep 09 23:28:06.851395 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.851266 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:28:06.858620 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.858596 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl"] Sep 09 23:28:06.889685 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.889644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:06.889843 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.889753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:06.889843 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.889822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzfq5\" (UniqueName: \"kubernetes.io/projected/d9830424-060f-49c9-bfb3-e2e8b027acdd-kube-api-access-kzfq5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:06.990667 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.990626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:06.990860 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.990699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:06.990860 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.990728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzfq5\" (UniqueName: \"kubernetes.io/projected/d9830424-060f-49c9-bfb3-e2e8b027acdd-kube-api-access-kzfq5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:06.991009 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.990988 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:06.991089 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.991070 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:06.998632 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:06.998600 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzfq5\" (UniqueName: \"kubernetes.io/projected/d9830424-060f-49c9-bfb3-e2e8b027acdd-kube-api-access-kzfq5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:07.157332 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:07.157227 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:07.431658 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:07.431574 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl"] Sep 09 23:28:07.434451 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:28:07.434422 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9830424_060f_49c9_bfb3_e2e8b027acdd.slice/crio-853f7b86d19f18fff8ab558bcd9bbdcd1765bf3d33952ef82a358d19b4a96d43 WatchSource:0}: Error finding container 853f7b86d19f18fff8ab558bcd9bbdcd1765bf3d33952ef82a358d19b4a96d43: Status 404 returned error can't find the container with id 853f7b86d19f18fff8ab558bcd9bbdcd1765bf3d33952ef82a358d19b4a96d43 Sep 09 23:28:07.804409 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:07.804299 2563 generic.go:356] "Generic (PLEG): container finished" podID="d9830424-060f-49c9-bfb3-e2e8b027acdd" containerID="d777f6aff16fd4c7ec9573a8e00a2d595f6209ab16c8f6f0495a2beb0d16b06a" exitCode=0 Sep 09 23:28:07.804409 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:07.804382 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" event={"ID":"d9830424-060f-49c9-bfb3-e2e8b027acdd","Type":"ContainerDied","Data":"d777f6aff16fd4c7ec9573a8e00a2d595f6209ab16c8f6f0495a2beb0d16b06a"} Sep 09 23:28:07.804599 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:07.804424 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" event={"ID":"d9830424-060f-49c9-bfb3-e2e8b027acdd","Type":"ContainerStarted","Data":"853f7b86d19f18fff8ab558bcd9bbdcd1765bf3d33952ef82a358d19b4a96d43"} Sep 09 23:28:08.810292 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:08.810254 2563 generic.go:356] "Generic (PLEG): container finished" podID="d9830424-060f-49c9-bfb3-e2e8b027acdd" containerID="dbac2b62195c7508483a5ca7087b98b7bfe7d2968693ca7f1c988c9e8c77a930" exitCode=0 Sep 09 23:28:08.810717 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:08.810338 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" event={"ID":"d9830424-060f-49c9-bfb3-e2e8b027acdd","Type":"ContainerDied","Data":"dbac2b62195c7508483a5ca7087b98b7bfe7d2968693ca7f1c988c9e8c77a930"} Sep 09 23:28:08.904660 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:08.904621 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd"] Sep 09 23:28:08.908227 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:08.908204 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:08.911010 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:08.910982 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 23:28:08.911159 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:08.911011 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 23:28:08.911159 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:08.911100 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 23:28:08.911159 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:08.911098 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 23:28:08.911463 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:08.911447 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-drfht\"" Sep 09 23:28:08.928583 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:08.928552 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd"] Sep 09 23:28:09.009170 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.009139 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/857c1282-ccd2-438b-82a6-3bcff8ca60c4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.009345 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.009183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/857c1282-ccd2-438b-82a6-3bcff8ca60c4-manifests\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.009345 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.009220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/857c1282-ccd2-438b-82a6-3bcff8ca60c4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.009428 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.009303 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvtlv\" (UniqueName: \"kubernetes.io/projected/857c1282-ccd2-438b-82a6-3bcff8ca60c4-kube-api-access-qvtlv\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.009428 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.009380 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/857c1282-ccd2-438b-82a6-3bcff8ca60c4-tmp\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.109811 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.109774 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/857c1282-ccd2-438b-82a6-3bcff8ca60c4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.109977 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.109821 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/857c1282-ccd2-438b-82a6-3bcff8ca60c4-manifests\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.109977 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.109932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/857c1282-ccd2-438b-82a6-3bcff8ca60c4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.110062 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.109992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvtlv\" (UniqueName: \"kubernetes.io/projected/857c1282-ccd2-438b-82a6-3bcff8ca60c4-kube-api-access-qvtlv\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.110062 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.110026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/857c1282-ccd2-438b-82a6-3bcff8ca60c4-tmp\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.110164 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.110133 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/857c1282-ccd2-438b-82a6-3bcff8ca60c4-manifests\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.112202 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.112177 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/857c1282-ccd2-438b-82a6-3bcff8ca60c4-tmp\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.112356 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.112279 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/857c1282-ccd2-438b-82a6-3bcff8ca60c4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.112422 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.112390 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/857c1282-ccd2-438b-82a6-3bcff8ca60c4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.119640 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.119616 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvtlv\" (UniqueName: \"kubernetes.io/projected/857c1282-ccd2-438b-82a6-3bcff8ca60c4-kube-api-access-qvtlv\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-prftd\" (UID: \"857c1282-ccd2-438b-82a6-3bcff8ca60c4\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.218957 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.218921 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:09.503934 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:28:09.503893 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod857c1282_ccd2_438b_82a6_3bcff8ca60c4.slice/crio-a4f6b901b77c09cea8d3cc47f942c2fd392389fe297efec8932f2f33900130a5 WatchSource:0}: Error finding container a4f6b901b77c09cea8d3cc47f942c2fd392389fe297efec8932f2f33900130a5: Status 404 returned error can't find the container with id a4f6b901b77c09cea8d3cc47f942c2fd392389fe297efec8932f2f33900130a5 Sep 09 23:28:09.504720 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.504695 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd"] Sep 09 23:28:09.817085 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.817057 2563 generic.go:356] "Generic (PLEG): container finished" podID="d9830424-060f-49c9-bfb3-e2e8b027acdd" containerID="18539acb4c8c0acadd2c11a185539187456882266f7171dd84747c8094a5cc74" exitCode=0 Sep 09 23:28:09.817507 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.817150 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" event={"ID":"d9830424-060f-49c9-bfb3-e2e8b027acdd","Type":"ContainerDied","Data":"18539acb4c8c0acadd2c11a185539187456882266f7171dd84747c8094a5cc74"} Sep 09 23:28:09.818474 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:09.818446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" event={"ID":"857c1282-ccd2-438b-82a6-3bcff8ca60c4","Type":"ContainerStarted","Data":"a4f6b901b77c09cea8d3cc47f942c2fd392389fe297efec8932f2f33900130a5"} Sep 09 23:28:12.399810 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.399784 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:12.539484 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.539451 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzfq5\" (UniqueName: \"kubernetes.io/projected/d9830424-060f-49c9-bfb3-e2e8b027acdd-kube-api-access-kzfq5\") pod \"d9830424-060f-49c9-bfb3-e2e8b027acdd\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " Sep 09 23:28:12.539636 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.539503 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-util\") pod \"d9830424-060f-49c9-bfb3-e2e8b027acdd\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " Sep 09 23:28:12.539636 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.539536 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-bundle\") pod \"d9830424-060f-49c9-bfb3-e2e8b027acdd\" (UID: \"d9830424-060f-49c9-bfb3-e2e8b027acdd\") " Sep 09 23:28:12.540325 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.540285 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-bundle" (OuterVolumeSpecName: "bundle") pod "d9830424-060f-49c9-bfb3-e2e8b027acdd" (UID: "d9830424-060f-49c9-bfb3-e2e8b027acdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:28:12.541647 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.541618 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9830424-060f-49c9-bfb3-e2e8b027acdd-kube-api-access-kzfq5" (OuterVolumeSpecName: "kube-api-access-kzfq5") pod "d9830424-060f-49c9-bfb3-e2e8b027acdd" (UID: "d9830424-060f-49c9-bfb3-e2e8b027acdd"). InnerVolumeSpecName "kube-api-access-kzfq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:28:12.545551 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.545501 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-util" (OuterVolumeSpecName: "util") pod "d9830424-060f-49c9-bfb3-e2e8b027acdd" (UID: "d9830424-060f-49c9-bfb3-e2e8b027acdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:28:12.641252 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.641167 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzfq5\" (UniqueName: \"kubernetes.io/projected/d9830424-060f-49c9-bfb3-e2e8b027acdd-kube-api-access-kzfq5\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:28:12.641252 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.641201 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-util\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:28:12.641252 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.641212 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9830424-060f-49c9-bfb3-e2e8b027acdd-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:28:12.836054 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.836020 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" Sep 09 23:28:12.836243 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.836015 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07dztl" event={"ID":"d9830424-060f-49c9-bfb3-e2e8b027acdd","Type":"ContainerDied","Data":"853f7b86d19f18fff8ab558bcd9bbdcd1765bf3d33952ef82a358d19b4a96d43"} Sep 09 23:28:12.836243 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.836163 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="853f7b86d19f18fff8ab558bcd9bbdcd1765bf3d33952ef82a358d19b4a96d43" Sep 09 23:28:12.837638 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:12.837617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" event={"ID":"857c1282-ccd2-438b-82a6-3bcff8ca60c4","Type":"ContainerStarted","Data":"1a0ec5b313e64c71c91a7f4850be1a5b58b06de2f51b15ca8ba75f8770ca6797"} Sep 09 23:28:13.843701 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:13.843664 2563 generic.go:356] "Generic (PLEG): container finished" podID="857c1282-ccd2-438b-82a6-3bcff8ca60c4" containerID="1a0ec5b313e64c71c91a7f4850be1a5b58b06de2f51b15ca8ba75f8770ca6797" exitCode=0 Sep 09 23:28:13.844165 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:13.843751 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" event={"ID":"857c1282-ccd2-438b-82a6-3bcff8ca60c4","Type":"ContainerDied","Data":"1a0ec5b313e64c71c91a7f4850be1a5b58b06de2f51b15ca8ba75f8770ca6797"} Sep 09 23:28:14.855151 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:14.855114 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" event={"ID":"857c1282-ccd2-438b-82a6-3bcff8ca60c4","Type":"ContainerStarted","Data":"640ed82a4305c18dc8a172dbd2035f4b519f4733a8fda82505f880933f5e7bc2"} Sep 09 23:28:14.855558 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:14.855254 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:14.878267 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:14.878213 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" podStartSLOduration=2.306620043 podStartE2EDuration="6.878196187s" totalImagesPullingTime="3.422697796s" totalInitContainerRuntime="1.148878348s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:28:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:28:14.876771368 +0000 UTC m=+349.169501933" watchObservedRunningTime="2026-09-09 23:28:14.878196187 +0000 UTC m=+349.170926751" Sep 09 23:28:25.862055 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:25.861976 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-prftd" Sep 09 23:28:28.302743 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.302708 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb"] Sep 09 23:28:28.303112 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.303007 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9830424-060f-49c9-bfb3-e2e8b027acdd" containerName="extract" Sep 09 23:28:28.303112 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.303018 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9830424-060f-49c9-bfb3-e2e8b027acdd" containerName="extract" Sep 09 23:28:28.303112 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.303033 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9830424-060f-49c9-bfb3-e2e8b027acdd" containerName="pull" Sep 09 23:28:28.303112 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.303038 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9830424-060f-49c9-bfb3-e2e8b027acdd" containerName="pull" Sep 09 23:28:28.303112 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.303053 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9830424-060f-49c9-bfb3-e2e8b027acdd" containerName="util" Sep 09 23:28:28.303112 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.303058 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9830424-060f-49c9-bfb3-e2e8b027acdd" containerName="util" Sep 09 23:28:28.303112 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.303109 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9830424-060f-49c9-bfb3-e2e8b027acdd" containerName="extract" Sep 09 23:28:28.305871 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.305853 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.308353 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.308287 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:28:28.309355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.309339 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 23:28:28.309473 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.309452 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 23:28:28.309541 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.309485 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 23:28:28.309541 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.309504 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 23:28:28.309541 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.309530 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8mbm6\"" Sep 09 23:28:28.321003 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.320977 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb"] Sep 09 23:28:28.479946 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.479913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d000f59-f117-4a2d-91cf-0531d27a6ed2-cert\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.480147 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.479956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d000f59-f117-4a2d-91cf-0531d27a6ed2-manager-config\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.480147 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.480080 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2qr4\" (UniqueName: \"kubernetes.io/projected/4d000f59-f117-4a2d-91cf-0531d27a6ed2-kube-api-access-g2qr4\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.480252 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.480146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d000f59-f117-4a2d-91cf-0531d27a6ed2-metrics-cert\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.580581 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.580551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d000f59-f117-4a2d-91cf-0531d27a6ed2-metrics-cert\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.580741 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.580596 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d000f59-f117-4a2d-91cf-0531d27a6ed2-cert\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.580741 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.580623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d000f59-f117-4a2d-91cf-0531d27a6ed2-manager-config\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.580741 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.580687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2qr4\" (UniqueName: \"kubernetes.io/projected/4d000f59-f117-4a2d-91cf-0531d27a6ed2-kube-api-access-g2qr4\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.581392 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.581369 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d000f59-f117-4a2d-91cf-0531d27a6ed2-manager-config\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.583162 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.583138 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d000f59-f117-4a2d-91cf-0531d27a6ed2-metrics-cert\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.583262 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.583167 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d000f59-f117-4a2d-91cf-0531d27a6ed2-cert\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.588170 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.588148 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2qr4\" (UniqueName: \"kubernetes.io/projected/4d000f59-f117-4a2d-91cf-0531d27a6ed2-kube-api-access-g2qr4\") pod \"lws-controller-manager-b488669bf-7qnxb\" (UID: \"4d000f59-f117-4a2d-91cf-0531d27a6ed2\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.615249 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.615215 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:28.885663 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.885571 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb"] Sep 09 23:28:28.889602 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:28:28.889573 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d000f59_f117_4a2d_91cf_0531d27a6ed2.slice/crio-640b42c9bb7aa045019179b097bb17642de63b2682009816edc022c236466969 WatchSource:0}: Error finding container 640b42c9bb7aa045019179b097bb17642de63b2682009816edc022c236466969: Status 404 returned error can't find the container with id 640b42c9bb7aa045019179b097bb17642de63b2682009816edc022c236466969 Sep 09 23:28:28.922292 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:28.922256 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" event={"ID":"4d000f59-f117-4a2d-91cf-0531d27a6ed2","Type":"ContainerStarted","Data":"640b42c9bb7aa045019179b097bb17642de63b2682009816edc022c236466969"} Sep 09 23:28:30.934047 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:30.934008 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" event={"ID":"4d000f59-f117-4a2d-91cf-0531d27a6ed2","Type":"ContainerStarted","Data":"58b4ba549b1dab080ce5869da9e548a88d871d8df5906370645cd66140b378f5"} Sep 09 23:28:30.934516 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:30.934084 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:30.949724 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:30.949663 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" podStartSLOduration=1.6204992740000002 podStartE2EDuration="2.949641301s" totalImagesPullingTime="1.329142027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:28:30.948721483 +0000 UTC m=+365.241452068" watchObservedRunningTime="2026-09-09 23:28:30.949641301 +0000 UTC m=+365.242371867" Sep 09 23:28:41.941315 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:41.941284 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b488669bf-7qnxb" Sep 09 23:28:46.806537 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.806498 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb"] Sep 09 23:28:46.813013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.812989 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.817792 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.817769 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 23:28:46.817918 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.817769 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c9dvf\"" Sep 09 23:28:46.817918 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.817768 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 09 23:28:46.818053 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.818034 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 09 23:28:46.818282 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.818267 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 09 23:28:46.819027 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.819010 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 23:28:46.819250 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.819235 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 23:28:46.849331 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.832339 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb"] Sep 09 23:28:46.852218 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.851667 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.852218 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.851720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.852218 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.851760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/83c04f5e-a43d-46bf-b36b-2e370511ed36-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.852218 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.851840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/83c04f5e-a43d-46bf-b36b-2e370511ed36-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.852218 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.851893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.852218 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.851919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.852218 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.851948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg9pc\" (UniqueName: \"kubernetes.io/projected/83c04f5e-a43d-46bf-b36b-2e370511ed36-kube-api-access-vg9pc\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.953170 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.953120 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/83c04f5e-a43d-46bf-b36b-2e370511ed36-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.953391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.953198 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.953391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.953224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.953391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.953248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg9pc\" (UniqueName: \"kubernetes.io/projected/83c04f5e-a43d-46bf-b36b-2e370511ed36-kube-api-access-vg9pc\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.953391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.953330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.953391 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.953364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.953696 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.953399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/83c04f5e-a43d-46bf-b36b-2e370511ed36-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.953967 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.953934 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.955498 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.955474 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/83c04f5e-a43d-46bf-b36b-2e370511ed36-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.955661 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.955639 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/83c04f5e-a43d-46bf-b36b-2e370511ed36-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.955747 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.955666 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.955801 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.955742 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.961605 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.961584 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83c04f5e-a43d-46bf-b36b-2e370511ed36-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:46.961961 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:46.961943 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg9pc\" (UniqueName: \"kubernetes.io/projected/83c04f5e-a43d-46bf-b36b-2e370511ed36-kube-api-access-vg9pc\") pod \"istiod-openshift-gateway-5677ccb49b-kdhzb\" (UID: \"83c04f5e-a43d-46bf-b36b-2e370511ed36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:47.122552 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:47.122515 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:47.421371 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:47.421343 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb"] Sep 09 23:28:47.424541 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:28:47.424513 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83c04f5e_a43d_46bf_b36b_2e370511ed36.slice/crio-07a9dfbba87b184923c749b6ab1e2cf4bba2c2b86f388612b11cffa5cd203a19 WatchSource:0}: Error finding container 07a9dfbba87b184923c749b6ab1e2cf4bba2c2b86f388612b11cffa5cd203a19: Status 404 returned error can't find the container with id 07a9dfbba87b184923c749b6ab1e2cf4bba2c2b86f388612b11cffa5cd203a19 Sep 09 23:28:48.016832 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:48.016795 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" event={"ID":"83c04f5e-a43d-46bf-b36b-2e370511ed36","Type":"ContainerStarted","Data":"07a9dfbba87b184923c749b6ab1e2cf4bba2c2b86f388612b11cffa5cd203a19"} Sep 09 23:28:49.883288 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:49.883248 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:28:49.883601 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:49.883352 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:28:50.030234 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.030195 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" event={"ID":"83c04f5e-a43d-46bf-b36b-2e370511ed36","Type":"ContainerStarted","Data":"37dd83083e2f424610a376f728a67ff7d83a6cec9cc6e44ce8cbdf1912608c7f"} Sep 09 23:28:50.030445 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.030426 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:50.033605 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.033578 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-kdhzb container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 09 23:28:50.033742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.033622 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" podUID="83c04f5e-a43d-46bf-b36b-2e370511ed36" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:28:50.054192 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.054145 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" podStartSLOduration=1.598015497 podStartE2EDuration="4.054130081s" totalImagesPullingTime="2.456114584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:28:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:28:50.052209144 +0000 UTC m=+384.344939711" watchObservedRunningTime="2026-09-09 23:28:50.054130081 +0000 UTC m=+384.346860646" Sep 09 23:28:50.905070 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.905035 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l"] Sep 09 23:28:50.908526 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.908508 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:50.912087 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.912065 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vdqpz\"" Sep 09 23:28:50.923140 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.923118 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l"] Sep 09 23:28:50.991442 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.991406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:50.991617 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.991497 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:50.991617 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.991537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:50.991696 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.991674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:50.991732 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.991715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:50.991800 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.991785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52afc451-0764-4a03-9562-29361eadf19e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:50.991835 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.991814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsmnm\" (UniqueName: \"kubernetes.io/projected/52afc451-0764-4a03-9562-29361eadf19e-kube-api-access-bsmnm\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:50.991868 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.991855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52afc451-0764-4a03-9562-29361eadf19e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:50.991913 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:50.991898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52afc451-0764-4a03-9562-29361eadf19e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.036003 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.035969 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kdhzb" Sep 09 23:28:51.093385 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.093339 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.093553 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.093390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.093553 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.093453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52afc451-0764-4a03-9562-29361eadf19e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.093553 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.093482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsmnm\" (UniqueName: \"kubernetes.io/projected/52afc451-0764-4a03-9562-29361eadf19e-kube-api-access-bsmnm\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.093553 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.093547 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52afc451-0764-4a03-9562-29361eadf19e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.093749 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.093612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52afc451-0764-4a03-9562-29361eadf19e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.093749 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.093671 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.093749 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.093731 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.093997 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.093819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.093997 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.093870 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.094173 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.094150 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52afc451-0764-4a03-9562-29361eadf19e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.094538 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.094511 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.094685 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.094655 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.094685 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.094678 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.096520 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.096489 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52afc451-0764-4a03-9562-29361eadf19e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.096638 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.096613 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52afc451-0764-4a03-9562-29361eadf19e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.102825 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.102800 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52afc451-0764-4a03-9562-29361eadf19e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.102917 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.102880 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsmnm\" (UniqueName: \"kubernetes.io/projected/52afc451-0764-4a03-9562-29361eadf19e-kube-api-access-bsmnm\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9l64l\" (UID: \"52afc451-0764-4a03-9562-29361eadf19e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.223761 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.223675 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:51.505862 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:51.505832 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l"] Sep 09 23:28:51.507525 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:28:51.507496 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52afc451_0764_4a03_9562_29361eadf19e.slice/crio-1a50d7f62da31829bb2b009c118ec62159279af3a830ee98301665914c061468 WatchSource:0}: Error finding container 1a50d7f62da31829bb2b009c118ec62159279af3a830ee98301665914c061468: Status 404 returned error can't find the container with id 1a50d7f62da31829bb2b009c118ec62159279af3a830ee98301665914c061468 Sep 09 23:28:52.040537 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:52.040494 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" event={"ID":"52afc451-0764-4a03-9562-29361eadf19e","Type":"ContainerStarted","Data":"1a50d7f62da31829bb2b009c118ec62159279af3a830ee98301665914c061468"} Sep 09 23:28:54.323281 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:54.323241 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:28:54.323689 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:54.323368 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:28:54.323689 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:54.323426 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:28:55.057752 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:55.057716 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" event={"ID":"52afc451-0764-4a03-9562-29361eadf19e","Type":"ContainerStarted","Data":"b84c71b9aea687b0ab4f91f82d3ed7a0fe197c7645856e7a72542f66444ac067"} Sep 09 23:28:55.079873 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:55.079816 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" podStartSLOduration=2.266526913 podStartE2EDuration="5.079799713s" totalImagesPullingTime="2.8132728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:28:55.078060871 +0000 UTC m=+389.370791466" watchObservedRunningTime="2026-09-09 23:28:55.079799713 +0000 UTC m=+389.372530277" Sep 09 23:28:55.224378 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:55.224341 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:55.230299 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:55.230272 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:56.062875 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:56.062844 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:28:56.063917 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:28:56.063895 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9l64l" Sep 09 23:29:02.381211 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.381172 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-556d78c84f-z2nrr"] Sep 09 23:29:02.385865 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.385846 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.394289 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.394260 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556d78c84f-z2nrr"] Sep 09 23:29:02.498362 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.498298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-trusted-ca-bundle\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.498362 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.498366 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4e47d89-98c7-4642-bad1-002460c7e804-console-serving-cert\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.498620 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.498393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-service-ca\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.498620 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.498425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-console-config\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.498620 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.498486 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4e47d89-98c7-4642-bad1-002460c7e804-console-oauth-config\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.498620 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.498592 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb67d\" (UniqueName: \"kubernetes.io/projected/a4e47d89-98c7-4642-bad1-002460c7e804-kube-api-access-vb67d\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.498780 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.498625 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-oauth-serving-cert\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.599338 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.599277 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb67d\" (UniqueName: \"kubernetes.io/projected/a4e47d89-98c7-4642-bad1-002460c7e804-kube-api-access-vb67d\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.599338 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.599343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-oauth-serving-cert\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.599571 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.599399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-trusted-ca-bundle\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.599571 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.599424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4e47d89-98c7-4642-bad1-002460c7e804-console-serving-cert\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.599571 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.599484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-service-ca\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.599571 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.599532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-console-config\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.599571 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.599552 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4e47d89-98c7-4642-bad1-002460c7e804-console-oauth-config\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.600208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.600168 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-oauth-serving-cert\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.600302 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.600265 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-service-ca\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.600399 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.600272 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-console-config\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.600461 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.600399 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e47d89-98c7-4642-bad1-002460c7e804-trusted-ca-bundle\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.601982 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.601956 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4e47d89-98c7-4642-bad1-002460c7e804-console-serving-cert\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.602075 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.602051 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4e47d89-98c7-4642-bad1-002460c7e804-console-oauth-config\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.606892 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.606866 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb67d\" (UniqueName: \"kubernetes.io/projected/a4e47d89-98c7-4642-bad1-002460c7e804-kube-api-access-vb67d\") pod \"console-556d78c84f-z2nrr\" (UID: \"a4e47d89-98c7-4642-bad1-002460c7e804\") " pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.695998 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.695928 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:02.970265 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:02.970187 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556d78c84f-z2nrr"] Sep 09 23:29:02.973224 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:29:02.973198 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e47d89_98c7_4642_bad1_002460c7e804.slice/crio-a143cc4c5a87e924454e0c7f3180d7ba45101e8a016eba315aee5d7115fb9bf4 WatchSource:0}: Error finding container a143cc4c5a87e924454e0c7f3180d7ba45101e8a016eba315aee5d7115fb9bf4: Status 404 returned error can't find the container with id a143cc4c5a87e924454e0c7f3180d7ba45101e8a016eba315aee5d7115fb9bf4 Sep 09 23:29:03.098027 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:03.097985 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556d78c84f-z2nrr" event={"ID":"a4e47d89-98c7-4642-bad1-002460c7e804","Type":"ContainerStarted","Data":"3c170ed164d38dca6842d465c68e8c5c2646485b27db46aea52180388dda3bae"} Sep 09 23:29:03.098189 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:03.098051 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556d78c84f-z2nrr" event={"ID":"a4e47d89-98c7-4642-bad1-002460c7e804","Type":"ContainerStarted","Data":"a143cc4c5a87e924454e0c7f3180d7ba45101e8a016eba315aee5d7115fb9bf4"} Sep 09 23:29:03.117091 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:03.117036 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-556d78c84f-z2nrr" podStartSLOduration=1.117019979 podStartE2EDuration="1.117019979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:29:03.115185227 +0000 UTC m=+397.407915813" watchObservedRunningTime="2026-09-09 23:29:03.117019979 +0000 UTC m=+397.409750543" Sep 09 23:29:12.696676 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:12.696634 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:12.697097 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:12.696704 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:12.701355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:12.701297 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:13.150653 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:13.150625 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-556d78c84f-z2nrr" Sep 09 23:29:13.195626 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:13.195584 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c97ccd68f-77b8p"] Sep 09 23:29:38.216902 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.216863 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c97ccd68f-77b8p" podUID="17cca3e8-1247-4c9d-9e4d-84db407a8c2c" containerName="console" containerID="cri-o://732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269" gracePeriod=15 Sep 09 23:29:38.460024 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.459998 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:29:38.514739 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.514662 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-oauth-config\") pod \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " Sep 09 23:29:38.514739 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.514713 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-serving-cert\") pod \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " Sep 09 23:29:38.514959 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.514746 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-config\") pod \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " Sep 09 23:29:38.514959 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.514777 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-trusted-ca-bundle\") pod \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " Sep 09 23:29:38.514959 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.514793 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skxfw\" (UniqueName: \"kubernetes.io/projected/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-kube-api-access-skxfw\") pod \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " Sep 09 23:29:38.514959 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.514811 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-service-ca\") pod \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " Sep 09 23:29:38.514959 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.514886 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-oauth-serving-cert\") pod \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\" (UID: \"17cca3e8-1247-4c9d-9e4d-84db407a8c2c\") " Sep 09 23:29:38.515231 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.515194 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-config" (OuterVolumeSpecName: "console-config") pod "17cca3e8-1247-4c9d-9e4d-84db407a8c2c" (UID: "17cca3e8-1247-4c9d-9e4d-84db407a8c2c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:29:38.515287 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.515217 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-service-ca" (OuterVolumeSpecName: "service-ca") pod "17cca3e8-1247-4c9d-9e4d-84db407a8c2c" (UID: "17cca3e8-1247-4c9d-9e4d-84db407a8c2c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:29:38.515287 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.515249 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "17cca3e8-1247-4c9d-9e4d-84db407a8c2c" (UID: "17cca3e8-1247-4c9d-9e4d-84db407a8c2c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:29:38.515517 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.515494 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "17cca3e8-1247-4c9d-9e4d-84db407a8c2c" (UID: "17cca3e8-1247-4c9d-9e4d-84db407a8c2c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:29:38.516930 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.516907 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "17cca3e8-1247-4c9d-9e4d-84db407a8c2c" (UID: "17cca3e8-1247-4c9d-9e4d-84db407a8c2c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:29:38.517019 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.516903 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-kube-api-access-skxfw" (OuterVolumeSpecName: "kube-api-access-skxfw") pod "17cca3e8-1247-4c9d-9e4d-84db407a8c2c" (UID: "17cca3e8-1247-4c9d-9e4d-84db407a8c2c"). InnerVolumeSpecName "kube-api-access-skxfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:29:38.517019 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.516936 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "17cca3e8-1247-4c9d-9e4d-84db407a8c2c" (UID: "17cca3e8-1247-4c9d-9e4d-84db407a8c2c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:29:38.615721 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.615685 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-serving-cert\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:38.615721 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.615716 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-config\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:38.615721 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.615725 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-trusted-ca-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:38.615937 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.615733 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skxfw\" (UniqueName: \"kubernetes.io/projected/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-kube-api-access-skxfw\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:38.615937 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.615742 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-service-ca\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:38.615937 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.615751 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-oauth-serving-cert\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:38.615937 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:38.615760 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17cca3e8-1247-4c9d-9e4d-84db407a8c2c-console-oauth-config\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:39.278267 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:39.278233 2563 generic.go:356] "Generic (PLEG): container finished" podID="17cca3e8-1247-4c9d-9e4d-84db407a8c2c" containerID="732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269" exitCode=0 Sep 09 23:29:39.278683 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:39.278281 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c97ccd68f-77b8p" Sep 09 23:29:39.278683 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:39.278340 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c97ccd68f-77b8p" event={"ID":"17cca3e8-1247-4c9d-9e4d-84db407a8c2c","Type":"ContainerDied","Data":"732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269"} Sep 09 23:29:39.278683 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:39.278394 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c97ccd68f-77b8p" event={"ID":"17cca3e8-1247-4c9d-9e4d-84db407a8c2c","Type":"ContainerDied","Data":"7af1496b74e7a28c5d88e581b6d4a3a5cd6ae3caaba71b1240d6852b06ee0b4a"} Sep 09 23:29:39.278683 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:39.278421 2563 scope.go:117] "RemoveContainer" containerID="732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269" Sep 09 23:29:39.293339 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:39.293298 2563 scope.go:117] "RemoveContainer" containerID="732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269" Sep 09 23:29:39.293622 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:29:39.293604 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269\": container with ID starting with 732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269 not found: ID does not exist" containerID="732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269" Sep 09 23:29:39.293687 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:39.293629 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269"} err="failed to get container status \"732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269\": rpc error: code = NotFound desc = could not find container \"732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269\": container with ID starting with 732d505f3bd8d3a2eac8db52723dccc7672b81da5fa5456a451c28d747ad4269 not found: ID does not exist" Sep 09 23:29:39.303385 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:39.303358 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c97ccd68f-77b8p"] Sep 09 23:29:39.307064 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:39.307041 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c97ccd68f-77b8p"] Sep 09 23:29:40.193070 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:40.193033 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17cca3e8-1247-4c9d-9e4d-84db407a8c2c" path="/var/lib/kubelet/pods/17cca3e8-1247-4c9d-9e4d-84db407a8c2c/volumes" Sep 09 23:29:43.246759 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.246719 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4"] Sep 09 23:29:43.247122 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.247048 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17cca3e8-1247-4c9d-9e4d-84db407a8c2c" containerName="console" Sep 09 23:29:43.247122 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.247059 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="17cca3e8-1247-4c9d-9e4d-84db407a8c2c" containerName="console" Sep 09 23:29:43.247209 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.247125 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="17cca3e8-1247-4c9d-9e4d-84db407a8c2c" containerName="console" Sep 09 23:29:43.251687 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.251669 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:43.254169 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.254142 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:29:43.255381 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.255359 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cqzxj\"" Sep 09 23:29:43.255528 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.255507 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:29:43.257750 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.257728 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4"] Sep 09 23:29:43.339085 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.339046 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp"] Sep 09 23:29:43.342629 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.342610 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:43.349718 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.349579 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp"] Sep 09 23:29:43.360383 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.360350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:43.360517 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.360406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk4h2\" (UniqueName: \"kubernetes.io/projected/f2defb1a-38f1-4e59-90db-a11aafed8a67-kube-api-access-jk4h2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:43.360517 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.360455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:43.441393 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.441359 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp"] Sep 09 23:29:43.445005 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.444986 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:43.451830 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.451804 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp"] Sep 09 23:29:43.461007 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.460980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk4h2\" (UniqueName: \"kubernetes.io/projected/f2defb1a-38f1-4e59-90db-a11aafed8a67-kube-api-access-jk4h2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:43.461161 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.461050 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:43.461161 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.461114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzgdn\" (UniqueName: \"kubernetes.io/projected/10eec07d-68e3-4687-b50b-67031ea5f42e-kube-api-access-xzgdn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:43.461279 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.461174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:43.461279 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.461228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:43.461405 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.461283 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:43.461440 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.461422 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:43.461661 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.461639 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:43.469059 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.469037 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk4h2\" (UniqueName: \"kubernetes.io/projected/f2defb1a-38f1-4e59-90db-a11aafed8a67-kube-api-access-jk4h2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:43.541852 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.541763 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx"] Sep 09 23:29:43.545529 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.545513 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:43.554891 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.554865 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx"] Sep 09 23:29:43.562328 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.562295 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:43.562545 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.562525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:43.562613 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.562563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzgdn\" (UniqueName: \"kubernetes.io/projected/10eec07d-68e3-4687-b50b-67031ea5f42e-kube-api-access-xzgdn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:43.562613 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.562588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:43.562683 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.562630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:43.562683 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.562647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:43.562743 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.562729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42smc\" (UniqueName: \"kubernetes.io/projected/6ee61200-f0d4-43ae-8582-33668543f4b8-kube-api-access-42smc\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:43.562950 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.562935 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:43.563052 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.563030 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:43.571167 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.571143 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzgdn\" (UniqueName: \"kubernetes.io/projected/10eec07d-68e3-4687-b50b-67031ea5f42e-kube-api-access-xzgdn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:43.652851 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.652812 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:43.663428 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.663397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42smc\" (UniqueName: \"kubernetes.io/projected/6ee61200-f0d4-43ae-8582-33668543f4b8-kube-api-access-42smc\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:43.663515 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.663440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:43.663585 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.663571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:43.663635 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.663600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:43.663692 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.663647 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:43.663692 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.663664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxhjh\" (UniqueName: \"kubernetes.io/projected/4662960c-2727-475f-82c1-6d45b3cfb5e7-kube-api-access-jxhjh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:43.663954 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.663932 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:43.664022 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.664002 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:43.672564 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.672536 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42smc\" (UniqueName: \"kubernetes.io/projected/6ee61200-f0d4-43ae-8582-33668543f4b8-kube-api-access-42smc\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:43.755621 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.755584 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:43.764116 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.764089 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:43.764239 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.764129 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxhjh\" (UniqueName: \"kubernetes.io/projected/4662960c-2727-475f-82c1-6d45b3cfb5e7-kube-api-access-jxhjh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:43.764239 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.764214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:43.764515 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.764492 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:43.764558 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.764536 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:43.772415 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.772389 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxhjh\" (UniqueName: \"kubernetes.io/projected/4662960c-2727-475f-82c1-6d45b3cfb5e7-kube-api-access-jxhjh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:43.835646 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.835598 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4"] Sep 09 23:29:43.837863 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:29:43.837815 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2defb1a_38f1_4e59_90db_a11aafed8a67.slice/crio-0a36231b31df221bc7ac729e712c88d90af8d2cfeb32168519b5533ca1f601bb WatchSource:0}: Error finding container 0a36231b31df221bc7ac729e712c88d90af8d2cfeb32168519b5533ca1f601bb: Status 404 returned error can't find the container with id 0a36231b31df221bc7ac729e712c88d90af8d2cfeb32168519b5533ca1f601bb Sep 09 23:29:43.856348 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.856296 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:43.933125 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:43.931992 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp"] Sep 09 23:29:43.935215 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:29:43.935181 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10eec07d_68e3_4687_b50b_67031ea5f42e.slice/crio-e8e6684fc035516b65ecb4e0b5d2376208f0f1e72e5a7af325e6bce8c4ce7c31 WatchSource:0}: Error finding container e8e6684fc035516b65ecb4e0b5d2376208f0f1e72e5a7af325e6bce8c4ce7c31: Status 404 returned error can't find the container with id e8e6684fc035516b65ecb4e0b5d2376208f0f1e72e5a7af325e6bce8c4ce7c31 Sep 09 23:29:44.028429 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.028407 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp"] Sep 09 23:29:44.030438 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:29:44.030409 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee61200_f0d4_43ae_8582_33668543f4b8.slice/crio-9c421f4558e1d71460fefb2cbbaa44c6df6e5c8b52dcd2a6ea171f1ecb0694d9 WatchSource:0}: Error finding container 9c421f4558e1d71460fefb2cbbaa44c6df6e5c8b52dcd2a6ea171f1ecb0694d9: Status 404 returned error can't find the container with id 9c421f4558e1d71460fefb2cbbaa44c6df6e5c8b52dcd2a6ea171f1ecb0694d9 Sep 09 23:29:44.128135 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.128104 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx"] Sep 09 23:29:44.176479 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:29:44.176437 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4662960c_2727_475f_82c1_6d45b3cfb5e7.slice/crio-0aa8961ee955b697f66085d65a41eae18bcf78b090645d188978ae70c3bd4056 WatchSource:0}: Error finding container 0aa8961ee955b697f66085d65a41eae18bcf78b090645d188978ae70c3bd4056: Status 404 returned error can't find the container with id 0aa8961ee955b697f66085d65a41eae18bcf78b090645d188978ae70c3bd4056 Sep 09 23:29:44.305400 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.305364 2563 generic.go:356] "Generic (PLEG): container finished" podID="4662960c-2727-475f-82c1-6d45b3cfb5e7" containerID="02cf7c3c3940a5e55384bab39c9c31a00ee29eaae12c7b7fdeab02d0cb2a139e" exitCode=0 Sep 09 23:29:44.305848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.305438 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" event={"ID":"4662960c-2727-475f-82c1-6d45b3cfb5e7","Type":"ContainerDied","Data":"02cf7c3c3940a5e55384bab39c9c31a00ee29eaae12c7b7fdeab02d0cb2a139e"} Sep 09 23:29:44.305848 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.305495 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" event={"ID":"4662960c-2727-475f-82c1-6d45b3cfb5e7","Type":"ContainerStarted","Data":"0aa8961ee955b697f66085d65a41eae18bcf78b090645d188978ae70c3bd4056"} Sep 09 23:29:44.307222 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.307197 2563 generic.go:356] "Generic (PLEG): container finished" podID="6ee61200-f0d4-43ae-8582-33668543f4b8" containerID="fb8e9610f791b8b032b9541c3ccbb66883d2eecea317d5a9b3a69e3c9369ed4d" exitCode=0 Sep 09 23:29:44.307317 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.307283 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" event={"ID":"6ee61200-f0d4-43ae-8582-33668543f4b8","Type":"ContainerDied","Data":"fb8e9610f791b8b032b9541c3ccbb66883d2eecea317d5a9b3a69e3c9369ed4d"} Sep 09 23:29:44.307386 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.307348 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" event={"ID":"6ee61200-f0d4-43ae-8582-33668543f4b8","Type":"ContainerStarted","Data":"9c421f4558e1d71460fefb2cbbaa44c6df6e5c8b52dcd2a6ea171f1ecb0694d9"} Sep 09 23:29:44.309119 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.309098 2563 generic.go:356] "Generic (PLEG): container finished" podID="10eec07d-68e3-4687-b50b-67031ea5f42e" containerID="b44a0d2b761b776ccb738ca384e046c4188700319baa69db44deea682df6191f" exitCode=0 Sep 09 23:29:44.309207 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.309166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" event={"ID":"10eec07d-68e3-4687-b50b-67031ea5f42e","Type":"ContainerDied","Data":"b44a0d2b761b776ccb738ca384e046c4188700319baa69db44deea682df6191f"} Sep 09 23:29:44.309269 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.309203 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" event={"ID":"10eec07d-68e3-4687-b50b-67031ea5f42e","Type":"ContainerStarted","Data":"e8e6684fc035516b65ecb4e0b5d2376208f0f1e72e5a7af325e6bce8c4ce7c31"} Sep 09 23:29:44.310911 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.310891 2563 generic.go:356] "Generic (PLEG): container finished" podID="f2defb1a-38f1-4e59-90db-a11aafed8a67" containerID="cb46d510746b46be230974926bd8ed40e3d3129b7558437325d0975ae483f0ef" exitCode=0 Sep 09 23:29:44.310968 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.310942 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" event={"ID":"f2defb1a-38f1-4e59-90db-a11aafed8a67","Type":"ContainerDied","Data":"cb46d510746b46be230974926bd8ed40e3d3129b7558437325d0975ae483f0ef"} Sep 09 23:29:44.311006 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:44.310982 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" event={"ID":"f2defb1a-38f1-4e59-90db-a11aafed8a67","Type":"ContainerStarted","Data":"0a36231b31df221bc7ac729e712c88d90af8d2cfeb32168519b5533ca1f601bb"} Sep 09 23:29:45.318585 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:45.318533 2563 generic.go:356] "Generic (PLEG): container finished" podID="10eec07d-68e3-4687-b50b-67031ea5f42e" containerID="a0294e63a122fbc49823faad6fd0090f916111bdf1b86253c6621f9cb468ee20" exitCode=0 Sep 09 23:29:45.319016 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:45.318650 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" event={"ID":"10eec07d-68e3-4687-b50b-67031ea5f42e","Type":"ContainerDied","Data":"a0294e63a122fbc49823faad6fd0090f916111bdf1b86253c6621f9cb468ee20"} Sep 09 23:29:46.326278 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:46.326242 2563 generic.go:356] "Generic (PLEG): container finished" podID="10eec07d-68e3-4687-b50b-67031ea5f42e" containerID="25dda038ef15cb3044e4ab30786409e2ac253b492b617395b88cb2411b387bc4" exitCode=0 Sep 09 23:29:46.326692 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:46.326330 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" event={"ID":"10eec07d-68e3-4687-b50b-67031ea5f42e","Type":"ContainerDied","Data":"25dda038ef15cb3044e4ab30786409e2ac253b492b617395b88cb2411b387bc4"} Sep 09 23:29:46.328126 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:46.328103 2563 generic.go:356] "Generic (PLEG): container finished" podID="f2defb1a-38f1-4e59-90db-a11aafed8a67" containerID="46ae6ad9fd5a9e14f9bdaca9671d72093c17c0db22ba93e23a9c46c2da1e0f18" exitCode=0 Sep 09 23:29:46.328238 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:46.328179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" event={"ID":"f2defb1a-38f1-4e59-90db-a11aafed8a67","Type":"ContainerDied","Data":"46ae6ad9fd5a9e14f9bdaca9671d72093c17c0db22ba93e23a9c46c2da1e0f18"} Sep 09 23:29:46.330132 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:46.330109 2563 generic.go:356] "Generic (PLEG): container finished" podID="4662960c-2727-475f-82c1-6d45b3cfb5e7" containerID="46a8a86d03f47a1cabea3a42e9cbd4be3cd7ffc48433e63b64e84832f8881a3f" exitCode=0 Sep 09 23:29:46.330218 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:46.330181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" event={"ID":"4662960c-2727-475f-82c1-6d45b3cfb5e7","Type":"ContainerDied","Data":"46a8a86d03f47a1cabea3a42e9cbd4be3cd7ffc48433e63b64e84832f8881a3f"} Sep 09 23:29:46.332140 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:46.332120 2563 generic.go:356] "Generic (PLEG): container finished" podID="6ee61200-f0d4-43ae-8582-33668543f4b8" containerID="cfffa7e2775f2f613711613a9acff29a19b40f77e8a4484992f8c9c108f34cae" exitCode=0 Sep 09 23:29:46.332215 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:46.332163 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" event={"ID":"6ee61200-f0d4-43ae-8582-33668543f4b8","Type":"ContainerDied","Data":"cfffa7e2775f2f613711613a9acff29a19b40f77e8a4484992f8c9c108f34cae"} Sep 09 23:29:47.340104 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.340067 2563 generic.go:356] "Generic (PLEG): container finished" podID="f2defb1a-38f1-4e59-90db-a11aafed8a67" containerID="bd84a60ef71c7ca2ea54b2657f132116a0e6c4460a9c1e7465d900fc67e383f8" exitCode=0 Sep 09 23:29:47.340499 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.340162 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" event={"ID":"f2defb1a-38f1-4e59-90db-a11aafed8a67","Type":"ContainerDied","Data":"bd84a60ef71c7ca2ea54b2657f132116a0e6c4460a9c1e7465d900fc67e383f8"} Sep 09 23:29:47.342429 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.342403 2563 generic.go:356] "Generic (PLEG): container finished" podID="4662960c-2727-475f-82c1-6d45b3cfb5e7" containerID="bc51913baa9bd100b413079e7e1acf93120a91742d848a4203cac62717cae9bc" exitCode=0 Sep 09 23:29:47.342553 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.342485 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" event={"ID":"4662960c-2727-475f-82c1-6d45b3cfb5e7","Type":"ContainerDied","Data":"bc51913baa9bd100b413079e7e1acf93120a91742d848a4203cac62717cae9bc"} Sep 09 23:29:47.344599 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.344576 2563 generic.go:356] "Generic (PLEG): container finished" podID="6ee61200-f0d4-43ae-8582-33668543f4b8" containerID="aa0d342519271e48eb05007aee0440f6c7a07b5815ef5158218d166009cee2d9" exitCode=0 Sep 09 23:29:47.344697 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.344646 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" event={"ID":"6ee61200-f0d4-43ae-8582-33668543f4b8","Type":"ContainerDied","Data":"aa0d342519271e48eb05007aee0440f6c7a07b5815ef5158218d166009cee2d9"} Sep 09 23:29:47.472627 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.472602 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:47.598251 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.598160 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzgdn\" (UniqueName: \"kubernetes.io/projected/10eec07d-68e3-4687-b50b-67031ea5f42e-kube-api-access-xzgdn\") pod \"10eec07d-68e3-4687-b50b-67031ea5f42e\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " Sep 09 23:29:47.598251 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.598199 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-bundle\") pod \"10eec07d-68e3-4687-b50b-67031ea5f42e\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " Sep 09 23:29:47.598496 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.598265 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-util\") pod \"10eec07d-68e3-4687-b50b-67031ea5f42e\" (UID: \"10eec07d-68e3-4687-b50b-67031ea5f42e\") " Sep 09 23:29:47.598791 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.598764 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-bundle" (OuterVolumeSpecName: "bundle") pod "10eec07d-68e3-4687-b50b-67031ea5f42e" (UID: "10eec07d-68e3-4687-b50b-67031ea5f42e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:29:47.600278 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.600253 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10eec07d-68e3-4687-b50b-67031ea5f42e-kube-api-access-xzgdn" (OuterVolumeSpecName: "kube-api-access-xzgdn") pod "10eec07d-68e3-4687-b50b-67031ea5f42e" (UID: "10eec07d-68e3-4687-b50b-67031ea5f42e"). InnerVolumeSpecName "kube-api-access-xzgdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:29:47.603935 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.603897 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-util" (OuterVolumeSpecName: "util") pod "10eec07d-68e3-4687-b50b-67031ea5f42e" (UID: "10eec07d-68e3-4687-b50b-67031ea5f42e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:29:47.699213 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.699168 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-util\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:47.699213 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.699204 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzgdn\" (UniqueName: \"kubernetes.io/projected/10eec07d-68e3-4687-b50b-67031ea5f42e-kube-api-access-xzgdn\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:47.699213 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:47.699215 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10eec07d-68e3-4687-b50b-67031ea5f42e-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:48.351855 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.351770 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" event={"ID":"10eec07d-68e3-4687-b50b-67031ea5f42e","Type":"ContainerDied","Data":"e8e6684fc035516b65ecb4e0b5d2376208f0f1e72e5a7af325e6bce8c4ce7c31"} Sep 09 23:29:48.351855 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.351797 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xtjdp" Sep 09 23:29:48.351855 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.351828 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8e6684fc035516b65ecb4e0b5d2376208f0f1e72e5a7af325e6bce8c4ce7c31" Sep 09 23:29:48.503258 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.503229 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:48.540991 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.540968 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:48.543929 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.543904 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:48.607228 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.607192 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxhjh\" (UniqueName: \"kubernetes.io/projected/4662960c-2727-475f-82c1-6d45b3cfb5e7-kube-api-access-jxhjh\") pod \"4662960c-2727-475f-82c1-6d45b3cfb5e7\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " Sep 09 23:29:48.607419 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.607289 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-bundle\") pod \"4662960c-2727-475f-82c1-6d45b3cfb5e7\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " Sep 09 23:29:48.607419 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.607346 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-util\") pod \"4662960c-2727-475f-82c1-6d45b3cfb5e7\" (UID: \"4662960c-2727-475f-82c1-6d45b3cfb5e7\") " Sep 09 23:29:48.608078 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.608043 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-bundle" (OuterVolumeSpecName: "bundle") pod "4662960c-2727-475f-82c1-6d45b3cfb5e7" (UID: "4662960c-2727-475f-82c1-6d45b3cfb5e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:29:48.609292 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.609267 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4662960c-2727-475f-82c1-6d45b3cfb5e7-kube-api-access-jxhjh" (OuterVolumeSpecName: "kube-api-access-jxhjh") pod "4662960c-2727-475f-82c1-6d45b3cfb5e7" (UID: "4662960c-2727-475f-82c1-6d45b3cfb5e7"). InnerVolumeSpecName "kube-api-access-jxhjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:29:48.612737 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.612706 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-util" (OuterVolumeSpecName: "util") pod "4662960c-2727-475f-82c1-6d45b3cfb5e7" (UID: "4662960c-2727-475f-82c1-6d45b3cfb5e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:29:48.708292 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.708191 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-bundle\") pod \"6ee61200-f0d4-43ae-8582-33668543f4b8\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " Sep 09 23:29:48.708495 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.708302 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-bundle\") pod \"f2defb1a-38f1-4e59-90db-a11aafed8a67\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " Sep 09 23:29:48.708495 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.708398 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk4h2\" (UniqueName: \"kubernetes.io/projected/f2defb1a-38f1-4e59-90db-a11aafed8a67-kube-api-access-jk4h2\") pod \"f2defb1a-38f1-4e59-90db-a11aafed8a67\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " Sep 09 23:29:48.708495 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.708456 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-util\") pod \"f2defb1a-38f1-4e59-90db-a11aafed8a67\" (UID: \"f2defb1a-38f1-4e59-90db-a11aafed8a67\") " Sep 09 23:29:48.708495 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.708490 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-util\") pod \"6ee61200-f0d4-43ae-8582-33668543f4b8\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " Sep 09 23:29:48.708706 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.708510 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42smc\" (UniqueName: \"kubernetes.io/projected/6ee61200-f0d4-43ae-8582-33668543f4b8-kube-api-access-42smc\") pod \"6ee61200-f0d4-43ae-8582-33668543f4b8\" (UID: \"6ee61200-f0d4-43ae-8582-33668543f4b8\") " Sep 09 23:29:48.708814 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.708778 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:48.708814 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.708799 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4662960c-2727-475f-82c1-6d45b3cfb5e7-util\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:48.708933 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.708813 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxhjh\" (UniqueName: \"kubernetes.io/projected/4662960c-2727-475f-82c1-6d45b3cfb5e7-kube-api-access-jxhjh\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:48.708988 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.708954 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-bundle" (OuterVolumeSpecName: "bundle") pod "f2defb1a-38f1-4e59-90db-a11aafed8a67" (UID: "f2defb1a-38f1-4e59-90db-a11aafed8a67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:29:48.708988 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.708964 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-bundle" (OuterVolumeSpecName: "bundle") pod "6ee61200-f0d4-43ae-8582-33668543f4b8" (UID: "6ee61200-f0d4-43ae-8582-33668543f4b8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:29:48.711177 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.711153 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2defb1a-38f1-4e59-90db-a11aafed8a67-kube-api-access-jk4h2" (OuterVolumeSpecName: "kube-api-access-jk4h2") pod "f2defb1a-38f1-4e59-90db-a11aafed8a67" (UID: "f2defb1a-38f1-4e59-90db-a11aafed8a67"). InnerVolumeSpecName "kube-api-access-jk4h2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:29:48.711177 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.711172 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ee61200-f0d4-43ae-8582-33668543f4b8-kube-api-access-42smc" (OuterVolumeSpecName: "kube-api-access-42smc") pod "6ee61200-f0d4-43ae-8582-33668543f4b8" (UID: "6ee61200-f0d4-43ae-8582-33668543f4b8"). InnerVolumeSpecName "kube-api-access-42smc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:29:48.714197 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.714175 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-util" (OuterVolumeSpecName: "util") pod "f2defb1a-38f1-4e59-90db-a11aafed8a67" (UID: "f2defb1a-38f1-4e59-90db-a11aafed8a67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:29:48.716479 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.716451 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-util" (OuterVolumeSpecName: "util") pod "6ee61200-f0d4-43ae-8582-33668543f4b8" (UID: "6ee61200-f0d4-43ae-8582-33668543f4b8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:29:48.809813 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.809770 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-util\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:48.809813 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.809803 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-util\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:48.809813 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.809813 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42smc\" (UniqueName: \"kubernetes.io/projected/6ee61200-f0d4-43ae-8582-33668543f4b8-kube-api-access-42smc\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:48.809813 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.809823 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ee61200-f0d4-43ae-8582-33668543f4b8-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:48.810056 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.809832 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2defb1a-38f1-4e59-90db-a11aafed8a67-bundle\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:48.810056 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:48.809840 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk4h2\" (UniqueName: \"kubernetes.io/projected/f2defb1a-38f1-4e59-90db-a11aafed8a67-kube-api-access-jk4h2\") on node \"ip-10-0-136-79.ec2.internal\" DevicePath \"\"" Sep 09 23:29:49.360682 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:49.360652 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" Sep 09 23:29:49.361073 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:49.360687 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fvsh4" event={"ID":"f2defb1a-38f1-4e59-90db-a11aafed8a67","Type":"ContainerDied","Data":"0a36231b31df221bc7ac729e712c88d90af8d2cfeb32168519b5533ca1f601bb"} Sep 09 23:29:49.361073 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:49.360748 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a36231b31df221bc7ac729e712c88d90af8d2cfeb32168519b5533ca1f601bb" Sep 09 23:29:49.362781 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:49.362760 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" Sep 09 23:29:49.362898 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:49.362781 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avn7mx" event={"ID":"4662960c-2727-475f-82c1-6d45b3cfb5e7","Type":"ContainerDied","Data":"0aa8961ee955b697f66085d65a41eae18bcf78b090645d188978ae70c3bd4056"} Sep 09 23:29:49.362898 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:49.362823 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0aa8961ee955b697f66085d65a41eae18bcf78b090645d188978ae70c3bd4056" Sep 09 23:29:49.364948 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:49.364926 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" event={"ID":"6ee61200-f0d4-43ae-8582-33668543f4b8","Type":"ContainerDied","Data":"9c421f4558e1d71460fefb2cbbaa44c6df6e5c8b52dcd2a6ea171f1ecb0694d9"} Sep 09 23:29:49.365018 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:49.364964 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz6zwp" Sep 09 23:29:49.365062 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:29:49.364966 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c421f4558e1d71460fefb2cbbaa44c6df6e5c8b52dcd2a6ea171f1ecb0694d9" Sep 09 23:30:44.851645 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.851608 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q"] Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.851993 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee61200-f0d4-43ae-8582-33668543f4b8" containerName="util" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852007 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee61200-f0d4-43ae-8582-33668543f4b8" containerName="util" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852016 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10eec07d-68e3-4687-b50b-67031ea5f42e" containerName="pull" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852021 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="10eec07d-68e3-4687-b50b-67031ea5f42e" containerName="pull" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852028 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4662960c-2727-475f-82c1-6d45b3cfb5e7" containerName="util" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852034 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4662960c-2727-475f-82c1-6d45b3cfb5e7" containerName="util" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852044 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4662960c-2727-475f-82c1-6d45b3cfb5e7" containerName="pull" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852050 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4662960c-2727-475f-82c1-6d45b3cfb5e7" containerName="pull" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852058 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10eec07d-68e3-4687-b50b-67031ea5f42e" containerName="util" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852063 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="10eec07d-68e3-4687-b50b-67031ea5f42e" containerName="util" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852069 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10eec07d-68e3-4687-b50b-67031ea5f42e" containerName="extract" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852074 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="10eec07d-68e3-4687-b50b-67031ea5f42e" containerName="extract" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852081 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee61200-f0d4-43ae-8582-33668543f4b8" containerName="pull" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852085 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee61200-f0d4-43ae-8582-33668543f4b8" containerName="pull" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852093 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4662960c-2727-475f-82c1-6d45b3cfb5e7" containerName="extract" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852098 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4662960c-2727-475f-82c1-6d45b3cfb5e7" containerName="extract" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852107 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2defb1a-38f1-4e59-90db-a11aafed8a67" containerName="util" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852112 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2defb1a-38f1-4e59-90db-a11aafed8a67" containerName="util" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852117 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2defb1a-38f1-4e59-90db-a11aafed8a67" containerName="pull" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852122 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2defb1a-38f1-4e59-90db-a11aafed8a67" containerName="pull" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852128 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee61200-f0d4-43ae-8582-33668543f4b8" containerName="extract" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852133 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee61200-f0d4-43ae-8582-33668543f4b8" containerName="extract" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852140 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2defb1a-38f1-4e59-90db-a11aafed8a67" containerName="extract" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852147 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2defb1a-38f1-4e59-90db-a11aafed8a67" containerName="extract" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852198 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2defb1a-38f1-4e59-90db-a11aafed8a67" containerName="extract" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852205 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ee61200-f0d4-43ae-8582-33668543f4b8" containerName="extract" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852212 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="10eec07d-68e3-4687-b50b-67031ea5f42e" containerName="extract" Sep 09 23:30:44.852208 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.852218 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4662960c-2727-475f-82c1-6d45b3cfb5e7" containerName="extract" Sep 09 23:30:44.856360 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.856339 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:44.859513 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.859492 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-frzhs\"" Sep 09 23:30:44.870842 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:44.870816 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q"] Sep 09 23:30:45.011521 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.011482 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.011709 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.011527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.011709 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.011554 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.011709 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.011576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.011709 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.011621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.011709 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.011690 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.011930 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.011729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s52gj\" (UniqueName: \"kubernetes.io/projected/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-kube-api-access-s52gj\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.011930 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.011815 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.011930 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.011866 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113124 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113124 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113361 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113361 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113361 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113361 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113576 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113361 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113576 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113576 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s52gj\" (UniqueName: \"kubernetes.io/projected/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-kube-api-access-s52gj\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113576 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113495 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113578 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113742 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113691 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.113874 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.113850 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.114128 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.114109 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.115401 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.115380 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.115680 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.115662 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.120620 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.120595 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.120747 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.120731 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s52gj\" (UniqueName: \"kubernetes.io/projected/b70412a9-e7ea-4b97-831b-e3f6e2caf91f-kube-api-access-s52gj\") pod \"maas-default-gateway-openshift-default-5ccb968c66-knv7q\" (UID: \"b70412a9-e7ea-4b97-831b-e3f6e2caf91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.166602 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.166572 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:45.442535 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.442503 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q"] Sep 09 23:30:45.444466 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:30:45.444435 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70412a9_e7ea_4b97_831b_e3f6e2caf91f.slice/crio-db86fcc5c6bdbfacd9d7ffa3e7532fa3a03831fb29b8c755be381111b75d03e2 WatchSource:0}: Error finding container db86fcc5c6bdbfacd9d7ffa3e7532fa3a03831fb29b8c755be381111b75d03e2: Status 404 returned error can't find the container with id db86fcc5c6bdbfacd9d7ffa3e7532fa3a03831fb29b8c755be381111b75d03e2 Sep 09 23:30:45.446919 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.446886 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:30:45.446978 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.446955 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:30:45.447013 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.446983 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:30:45.664981 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.664945 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" event={"ID":"b70412a9-e7ea-4b97-831b-e3f6e2caf91f","Type":"ContainerStarted","Data":"19f7ca1e4c195658bce6676fa9dfb6422f64111f0b526159a08adf36fbeda115"} Sep 09 23:30:45.665150 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.665003 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" event={"ID":"b70412a9-e7ea-4b97-831b-e3f6e2caf91f","Type":"ContainerStarted","Data":"db86fcc5c6bdbfacd9d7ffa3e7532fa3a03831fb29b8c755be381111b75d03e2"} Sep 09 23:30:45.685899 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:45.685849 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" podStartSLOduration=1.6858289260000001 podStartE2EDuration="1.685828926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:30:45.683249209 +0000 UTC m=+499.975979794" watchObservedRunningTime="2026-09-09 23:30:45.685828926 +0000 UTC m=+499.978559491" Sep 09 23:30:46.167619 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:46.167584 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:46.169061 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:46.169034 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-knv7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Sep 09 23:30:46.169159 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:46.169090 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" podUID="b70412a9-e7ea-4b97-831b-e3f6e2caf91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Sep 09 23:30:47.171463 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:47.171429 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:47.677964 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:47.677927 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:30:47.678874 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:30:47.678856 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:31:57.690896 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.690860 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp"] Sep 09 23:31:57.694053 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.694035 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" Sep 09 23:31:57.696452 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.696432 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 09 23:31:57.696503 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.696458 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-n94kc\"" Sep 09 23:31:57.704934 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.704910 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp"] Sep 09 23:31:57.732249 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.732222 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-mcz5n"] Sep 09 23:31:57.735425 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.735409 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" Sep 09 23:31:57.744577 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.744551 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-mcz5n"] Sep 09 23:31:57.761662 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.761629 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02436482-d54e-4e36-a4d5-10f6bf365a70-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-g8fzp\" (UID: \"02436482-d54e-4e36-a4d5-10f6bf365a70\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" Sep 09 23:31:57.761783 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.761679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7hlc\" (UniqueName: \"kubernetes.io/projected/02436482-d54e-4e36-a4d5-10f6bf365a70-kube-api-access-n7hlc\") pod \"payload-pre-processing-59fbc47bf8-g8fzp\" (UID: \"02436482-d54e-4e36-a4d5-10f6bf365a70\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" Sep 09 23:31:57.863108 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.863070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6449c9c-d258-4cc8-b072-552d4c3ce21e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-mcz5n\" (UID: \"c6449c9c-d258-4cc8-b072-552d4c3ce21e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" Sep 09 23:31:57.863294 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.863158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02436482-d54e-4e36-a4d5-10f6bf365a70-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-g8fzp\" (UID: \"02436482-d54e-4e36-a4d5-10f6bf365a70\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" Sep 09 23:31:57.863294 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.863185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s2ng\" (UniqueName: \"kubernetes.io/projected/c6449c9c-d258-4cc8-b072-552d4c3ce21e-kube-api-access-2s2ng\") pod \"payload-processing-5b54b7fbb7-mcz5n\" (UID: \"c6449c9c-d258-4cc8-b072-552d4c3ce21e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" Sep 09 23:31:57.863294 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.863236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7hlc\" (UniqueName: \"kubernetes.io/projected/02436482-d54e-4e36-a4d5-10f6bf365a70-kube-api-access-n7hlc\") pod \"payload-pre-processing-59fbc47bf8-g8fzp\" (UID: \"02436482-d54e-4e36-a4d5-10f6bf365a70\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" Sep 09 23:31:57.863916 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.863890 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02436482-d54e-4e36-a4d5-10f6bf365a70-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-g8fzp\" (UID: \"02436482-d54e-4e36-a4d5-10f6bf365a70\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" Sep 09 23:31:57.873976 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.873953 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7hlc\" (UniqueName: \"kubernetes.io/projected/02436482-d54e-4e36-a4d5-10f6bf365a70-kube-api-access-n7hlc\") pod \"payload-pre-processing-59fbc47bf8-g8fzp\" (UID: \"02436482-d54e-4e36-a4d5-10f6bf365a70\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" Sep 09 23:31:57.964371 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.964250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6449c9c-d258-4cc8-b072-552d4c3ce21e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-mcz5n\" (UID: \"c6449c9c-d258-4cc8-b072-552d4c3ce21e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" Sep 09 23:31:57.964371 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.964363 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s2ng\" (UniqueName: \"kubernetes.io/projected/c6449c9c-d258-4cc8-b072-552d4c3ce21e-kube-api-access-2s2ng\") pod \"payload-processing-5b54b7fbb7-mcz5n\" (UID: \"c6449c9c-d258-4cc8-b072-552d4c3ce21e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" Sep 09 23:31:57.964959 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.964936 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6449c9c-d258-4cc8-b072-552d4c3ce21e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-mcz5n\" (UID: \"c6449c9c-d258-4cc8-b072-552d4c3ce21e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" Sep 09 23:31:57.972297 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:57.972268 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s2ng\" (UniqueName: \"kubernetes.io/projected/c6449c9c-d258-4cc8-b072-552d4c3ce21e-kube-api-access-2s2ng\") pod \"payload-processing-5b54b7fbb7-mcz5n\" (UID: \"c6449c9c-d258-4cc8-b072-552d4c3ce21e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" Sep 09 23:31:58.005168 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:58.005125 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" Sep 09 23:31:58.045991 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:58.045959 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" Sep 09 23:31:58.278999 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:58.278967 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp"] Sep 09 23:31:58.280431 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:31:58.280404 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02436482_d54e_4e36_a4d5_10f6bf365a70.slice/crio-31a1350fec647ff1caf185ccd9f5c5be934c865a2c0fdda9e08af36c5f15f302 WatchSource:0}: Error finding container 31a1350fec647ff1caf185ccd9f5c5be934c865a2c0fdda9e08af36c5f15f302: Status 404 returned error can't find the container with id 31a1350fec647ff1caf185ccd9f5c5be934c865a2c0fdda9e08af36c5f15f302 Sep 09 23:31:58.331020 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:58.330992 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-mcz5n"] Sep 09 23:31:58.332868 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:31:58.332843 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6449c9c_d258_4cc8_b072_552d4c3ce21e.slice/crio-a0c27fbd02a091bd6d46c4d7dc1ef315e224978f27321a418bb520f6d4d32a71 WatchSource:0}: Error finding container a0c27fbd02a091bd6d46c4d7dc1ef315e224978f27321a418bb520f6d4d32a71: Status 404 returned error can't find the container with id a0c27fbd02a091bd6d46c4d7dc1ef315e224978f27321a418bb520f6d4d32a71 Sep 09 23:31:59.056371 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:59.056334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" event={"ID":"02436482-d54e-4e36-a4d5-10f6bf365a70","Type":"ContainerStarted","Data":"31a1350fec647ff1caf185ccd9f5c5be934c865a2c0fdda9e08af36c5f15f302"} Sep 09 23:31:59.057560 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:31:59.057537 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" event={"ID":"c6449c9c-d258-4cc8-b072-552d4c3ce21e","Type":"ContainerStarted","Data":"a0c27fbd02a091bd6d46c4d7dc1ef315e224978f27321a418bb520f6d4d32a71"} Sep 09 23:32:01.084716 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:01.084668 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" event={"ID":"02436482-d54e-4e36-a4d5-10f6bf365a70","Type":"ContainerStarted","Data":"552bb8b8688e7a34824ec29d6f515f94a009d8377e6a1cde0d20f7c4c6e690ec"} Sep 09 23:32:01.085225 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:01.084996 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" Sep 09 23:32:01.097757 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:01.097723 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" event={"ID":"c6449c9c-d258-4cc8-b072-552d4c3ce21e","Type":"ContainerStarted","Data":"cbb0b186d0d97f63694bb0ea776bfbdffa35546710940b3d6ea70a9aa7ab9c63"} Sep 09 23:32:01.098556 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:01.098535 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" Sep 09 23:32:01.105188 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:01.105124 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" podStartSLOduration=1.6515541 podStartE2EDuration="4.105105057s" totalImagesPullingTime="2.453550957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:32:01.104847466 +0000 UTC m=+575.397578060" watchObservedRunningTime="2026-09-09 23:32:01.105105057 +0000 UTC m=+575.397835622" Sep 09 23:32:01.125153 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:01.125093 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" podStartSLOduration=1.717344066 podStartE2EDuration="4.125072178s" totalImagesPullingTime="2.407728112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:32:01.121829357 +0000 UTC m=+575.414559951" watchObservedRunningTime="2026-09-09 23:32:01.125072178 +0000 UTC m=+575.417802744" Sep 09 23:32:07.133878 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:07.133845 2563 generic.go:356] "Generic (PLEG): container finished" podID="b70412a9-e7ea-4b97-831b-e3f6e2caf91f" containerID="19f7ca1e4c195658bce6676fa9dfb6422f64111f0b526159a08adf36fbeda115" exitCode=0 Sep 09 23:32:07.134282 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:07.133919 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" event={"ID":"b70412a9-e7ea-4b97-831b-e3f6e2caf91f","Type":"ContainerDied","Data":"19f7ca1e4c195658bce6676fa9dfb6422f64111f0b526159a08adf36fbeda115"} Sep 09 23:32:07.134364 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:07.134301 2563 scope.go:117] "RemoveContainer" containerID="19f7ca1e4c195658bce6676fa9dfb6422f64111f0b526159a08adf36fbeda115" Sep 09 23:32:07.135317 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:07.135283 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:32:07.135408 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:07.135388 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:32:07.135465 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:07.135444 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:32:08.141326 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:08.141267 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" event={"ID":"b70412a9-e7ea-4b97-831b-e3f6e2caf91f","Type":"ContainerStarted","Data":"d3fe116c40646645e6159c85724483ec005686170e567c43cb815fbc06fc5098"} Sep 09 23:32:08.167367 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:08.167327 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:32:08.167548 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:08.167448 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-knv7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Sep 09 23:32:08.167548 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:08.167518 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" podUID="b70412a9-e7ea-4b97-831b-e3f6e2caf91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Sep 09 23:32:09.167257 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:09.167214 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-knv7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Sep 09 23:32:09.167785 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:09.167287 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" podUID="b70412a9-e7ea-4b97-831b-e3f6e2caf91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Sep 09 23:32:10.167126 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:10.167087 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-knv7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Sep 09 23:32:10.167496 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:10.167439 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" podUID="b70412a9-e7ea-4b97-831b-e3f6e2caf91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Sep 09 23:32:11.167717 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:11.167669 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-knv7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Sep 09 23:32:11.168365 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:11.167752 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" podUID="b70412a9-e7ea-4b97-831b-e3f6e2caf91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Sep 09 23:32:12.107360 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.107326 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g8fzp" Sep 09 23:32:12.107581 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.107440 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-mcz5n" Sep 09 23:32:12.178674 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.176423 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-knv7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Sep 09 23:32:12.178674 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.176489 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" podUID="b70412a9-e7ea-4b97-831b-e3f6e2caf91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Sep 09 23:32:12.788476 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.788440 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft"] Sep 09 23:32:12.794325 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.794275 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft"] Sep 09 23:32:12.794502 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.794439 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.797098 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.797068 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 09 23:32:12.797098 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.797072 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 23:32:12.797324 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.797082 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 23:32:12.798068 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.798019 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vbsg8\"" Sep 09 23:32:12.830678 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.830630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33885755-289d-4acc-9802-cca8dcf6b20e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.830879 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.830699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.830879 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.830722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.830879 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.830771 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.830879 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.830811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ljlj\" (UniqueName: \"kubernetes.io/projected/33885755-289d-4acc-9802-cca8dcf6b20e-kube-api-access-7ljlj\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.830879 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.830872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.931527 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.931482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.931730 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.931570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33885755-289d-4acc-9802-cca8dcf6b20e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.931730 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.931621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.931730 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.931661 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.931730 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.931699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.931937 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.931745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ljlj\" (UniqueName: \"kubernetes.io/projected/33885755-289d-4acc-9802-cca8dcf6b20e-kube-api-access-7ljlj\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.931937 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.931891 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.932270 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.932024 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.932270 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.932054 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.933952 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.933928 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33885755-289d-4acc-9802-cca8dcf6b20e-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.934111 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.934090 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33885755-289d-4acc-9802-cca8dcf6b20e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:12.939857 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:12.939833 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ljlj\" (UniqueName: \"kubernetes.io/projected/33885755-289d-4acc-9802-cca8dcf6b20e-kube-api-access-7ljlj\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7xnft\" (UID: \"33885755-289d-4acc-9802-cca8dcf6b20e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:13.105828 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:13.105782 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:13.188187 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:13.188154 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:32:13.188889 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:13.188817 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:32:13.190442 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:13.190373 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-knv7q" Sep 09 23:32:13.396498 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:13.396464 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft"] Sep 09 23:32:13.398016 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:32:13.397990 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33885755_289d_4acc_9802_cca8dcf6b20e.slice/crio-28df9145be5e2f627b5340bc01c60e89acbad544bc23983980885868f3c4385b WatchSource:0}: Error finding container 28df9145be5e2f627b5340bc01c60e89acbad544bc23983980885868f3c4385b: Status 404 returned error can't find the container with id 28df9145be5e2f627b5340bc01c60e89acbad544bc23983980885868f3c4385b Sep 09 23:32:14.180721 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:14.180676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" event={"ID":"33885755-289d-4acc-9802-cca8dcf6b20e","Type":"ContainerStarted","Data":"28df9145be5e2f627b5340bc01c60e89acbad544bc23983980885868f3c4385b"} Sep 09 23:32:15.187855 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:15.187817 2563 generic.go:356] "Generic (PLEG): container finished" podID="33885755-289d-4acc-9802-cca8dcf6b20e" containerID="6682224a6e5ff4ca5f889d2f515be6525a9a30d97002520387e0fddebda86801" exitCode=0 Sep 09 23:32:15.188355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:15.187898 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" event={"ID":"33885755-289d-4acc-9802-cca8dcf6b20e","Type":"ContainerDied","Data":"6682224a6e5ff4ca5f889d2f515be6525a9a30d97002520387e0fddebda86801"} Sep 09 23:32:15.188355 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:15.188161 2563 scope.go:117] "RemoveContainer" containerID="6682224a6e5ff4ca5f889d2f515be6525a9a30d97002520387e0fddebda86801" Sep 09 23:32:16.195084 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:16.195048 2563 generic.go:356] "Generic (PLEG): container finished" podID="33885755-289d-4acc-9802-cca8dcf6b20e" containerID="7d44c611eb292f527fecc3e8ceb8cb3768109e2d8c5f6fde703ee8486ba92c65" exitCode=0 Sep 09 23:32:16.195553 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:16.195100 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" event={"ID":"33885755-289d-4acc-9802-cca8dcf6b20e","Type":"ContainerDied","Data":"7d44c611eb292f527fecc3e8ceb8cb3768109e2d8c5f6fde703ee8486ba92c65"} Sep 09 23:32:16.195553 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:16.195142 2563 scope.go:117] "RemoveContainer" containerID="6682224a6e5ff4ca5f889d2f515be6525a9a30d97002520387e0fddebda86801" Sep 09 23:32:16.195553 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:16.195390 2563 scope.go:117] "RemoveContainer" containerID="7d44c611eb292f527fecc3e8ceb8cb3768109e2d8c5f6fde703ee8486ba92c65" Sep 09 23:32:16.195685 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:32:16.195608 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:32:17.201836 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:17.201807 2563 scope.go:117] "RemoveContainer" containerID="7d44c611eb292f527fecc3e8ceb8cb3768109e2d8c5f6fde703ee8486ba92c65" Sep 09 23:32:17.202224 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:32:17.201999 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:32:23.106640 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:23.106601 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:23.107038 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:23.106661 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:23.107038 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:23.106679 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:23.107038 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:23.106691 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:23.107139 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:23.107087 2563 scope.go:117] "RemoveContainer" containerID="7d44c611eb292f527fecc3e8ceb8cb3768109e2d8c5f6fde703ee8486ba92c65" Sep 09 23:32:23.107279 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:32:23.107260 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:32:35.187509 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:35.187474 2563 scope.go:117] "RemoveContainer" containerID="7d44c611eb292f527fecc3e8ceb8cb3768109e2d8c5f6fde703ee8486ba92c65" Sep 09 23:32:35.188017 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:35.187741 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:32:36.309460 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:36.309423 2563 generic.go:356] "Generic (PLEG): container finished" podID="33885755-289d-4acc-9802-cca8dcf6b20e" containerID="508d11a4dff6d1eb05132fa713cff7515778f8e9f075f855d7be8d59ceb08fce" exitCode=0 Sep 09 23:32:36.309888 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:36.309497 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" event={"ID":"33885755-289d-4acc-9802-cca8dcf6b20e","Type":"ContainerDied","Data":"508d11a4dff6d1eb05132fa713cff7515778f8e9f075f855d7be8d59ceb08fce"} Sep 09 23:32:36.309888 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:36.309559 2563 scope.go:117] "RemoveContainer" containerID="7d44c611eb292f527fecc3e8ceb8cb3768109e2d8c5f6fde703ee8486ba92c65" Sep 09 23:32:36.310016 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:36.309903 2563 scope.go:117] "RemoveContainer" containerID="508d11a4dff6d1eb05132fa713cff7515778f8e9f075f855d7be8d59ceb08fce" Sep 09 23:32:36.310113 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:32:36.310093 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:32:43.106636 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:43.106593 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:43.107038 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:43.106657 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:43.107038 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:43.106672 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:43.107038 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:43.106686 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:32:43.107038 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:43.107016 2563 scope.go:117] "RemoveContainer" containerID="508d11a4dff6d1eb05132fa713cff7515778f8e9f075f855d7be8d59ceb08fce" Sep 09 23:32:43.107212 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:32:43.107195 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:32:46.159766 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.159727 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6"] Sep 09 23:32:46.162754 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.162738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.165142 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.165117 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 09 23:32:46.171241 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.171218 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6"] Sep 09 23:32:46.349547 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.349503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.349547 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.349558 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b1122d9-c34c-491d-abfc-295f58302365-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.349782 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.349659 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.349782 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.349702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.349782 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.349724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph4qm\" (UniqueName: \"kubernetes.io/projected/7b1122d9-c34c-491d-abfc-295f58302365-kube-api-access-ph4qm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.349782 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.349779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.450750 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.450663 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.450750 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.450714 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.450750 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.450745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b1122d9-c34c-491d-abfc-295f58302365-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.451021 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.450915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.451021 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.450980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.451021 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.451014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph4qm\" (UniqueName: \"kubernetes.io/projected/7b1122d9-c34c-491d-abfc-295f58302365-kube-api-access-ph4qm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.451171 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.451063 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.451229 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.451188 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.451354 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.451330 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.452922 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.452902 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b1122d9-c34c-491d-abfc-295f58302365-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.453229 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.453214 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b1122d9-c34c-491d-abfc-295f58302365-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.458315 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.458288 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph4qm\" (UniqueName: \"kubernetes.io/projected/7b1122d9-c34c-491d-abfc-295f58302365-kube-api-access-ph4qm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6\" (UID: \"7b1122d9-c34c-491d-abfc-295f58302365\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.474301 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.474278 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:46.744519 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:46.744435 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6"] Sep 09 23:32:46.747478 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:32:46.747435 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1122d9_c34c_491d_abfc_295f58302365.slice/crio-9765acd09677ef0c875a8b721759b114f7b96376e8e59c3da696ef6947cd0c65 WatchSource:0}: Error finding container 9765acd09677ef0c875a8b721759b114f7b96376e8e59c3da696ef6947cd0c65: Status 404 returned error can't find the container with id 9765acd09677ef0c875a8b721759b114f7b96376e8e59c3da696ef6947cd0c65 Sep 09 23:32:47.370112 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:47.370072 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" event={"ID":"7b1122d9-c34c-491d-abfc-295f58302365","Type":"ContainerStarted","Data":"78fdb0419541712b9c140e372c2ad342e8927eb778b3a9fbde5a74366dbcb42b"} Sep 09 23:32:47.370563 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:47.370136 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" event={"ID":"7b1122d9-c34c-491d-abfc-295f58302365","Type":"ContainerStarted","Data":"9765acd09677ef0c875a8b721759b114f7b96376e8e59c3da696ef6947cd0c65"} Sep 09 23:32:47.387981 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:47.387924 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" podStartSLOduration=1.212007472 podStartE2EDuration="1.387909606s" totalImagesPullingTime="175.902134ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:32:47.385655186 +0000 UTC m=+621.678385751" watchObservedRunningTime="2026-09-09 23:32:47.387909606 +0000 UTC m=+621.680640170" Sep 09 23:32:56.192016 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:56.191942 2563 scope.go:117] "RemoveContainer" containerID="508d11a4dff6d1eb05132fa713cff7515778f8e9f075f855d7be8d59ceb08fce" Sep 09 23:32:56.475254 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:56.475230 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:56.475361 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:56.475286 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:56.487810 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:56.487789 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:32:57.425794 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:57.425757 2563 generic.go:356] "Generic (PLEG): container finished" podID="33885755-289d-4acc-9802-cca8dcf6b20e" containerID="e9a024e38904ea4d70d4f3fbaf8fcd5328b861e06b7e130cd6836ca589d16f79" exitCode=0 Sep 09 23:32:57.426242 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:57.425829 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" event={"ID":"33885755-289d-4acc-9802-cca8dcf6b20e","Type":"ContainerDied","Data":"e9a024e38904ea4d70d4f3fbaf8fcd5328b861e06b7e130cd6836ca589d16f79"} Sep 09 23:32:57.426242 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:57.425889 2563 scope.go:117] "RemoveContainer" containerID="508d11a4dff6d1eb05132fa713cff7515778f8e9f075f855d7be8d59ceb08fce" Sep 09 23:32:57.426406 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:57.426352 2563 scope.go:117] "RemoveContainer" containerID="e9a024e38904ea4d70d4f3fbaf8fcd5328b861e06b7e130cd6836ca589d16f79" Sep 09 23:32:57.426586 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:32:57.426561 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:32:57.437734 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:32:57.437718 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6" Sep 09 23:33:03.106057 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:03.106004 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:33:03.106475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:03.106086 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:33:03.106475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:03.106102 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:33:03.106475 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:03.106119 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:33:03.106605 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:03.106509 2563 scope.go:117] "RemoveContainer" containerID="e9a024e38904ea4d70d4f3fbaf8fcd5328b861e06b7e130cd6836ca589d16f79" Sep 09 23:33:03.106696 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:33:03.106676 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:33:17.187791 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:17.187758 2563 scope.go:117] "RemoveContainer" containerID="e9a024e38904ea4d70d4f3fbaf8fcd5328b861e06b7e130cd6836ca589d16f79" Sep 09 23:33:17.188277 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:33:17.187940 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:33:29.187805 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:29.187772 2563 scope.go:117] "RemoveContainer" containerID="e9a024e38904ea4d70d4f3fbaf8fcd5328b861e06b7e130cd6836ca589d16f79" Sep 09 23:33:29.188181 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:33:29.187965 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:33:40.188090 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:40.188054 2563 scope.go:117] "RemoveContainer" containerID="e9a024e38904ea4d70d4f3fbaf8fcd5328b861e06b7e130cd6836ca589d16f79" Sep 09 23:33:40.659720 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:40.659685 2563 generic.go:356] "Generic (PLEG): container finished" podID="33885755-289d-4acc-9802-cca8dcf6b20e" containerID="2ce492e0a891e13a9599d3fd9eff5d06fb8cededece75b87d39c48248f6579a6" exitCode=0 Sep 09 23:33:40.659888 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:40.659760 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" event={"ID":"33885755-289d-4acc-9802-cca8dcf6b20e","Type":"ContainerDied","Data":"2ce492e0a891e13a9599d3fd9eff5d06fb8cededece75b87d39c48248f6579a6"} Sep 09 23:33:40.659888 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:40.659846 2563 scope.go:117] "RemoveContainer" containerID="e9a024e38904ea4d70d4f3fbaf8fcd5328b861e06b7e130cd6836ca589d16f79" Sep 09 23:33:40.660177 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:40.660155 2563 scope.go:117] "RemoveContainer" containerID="2ce492e0a891e13a9599d3fd9eff5d06fb8cededece75b87d39c48248f6579a6" Sep 09 23:33:40.660402 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:33:40.660379 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:33:43.106186 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:43.106153 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:33:43.106598 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:43.106209 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:33:43.106598 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:43.106227 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:33:43.106598 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:43.106244 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:33:43.106598 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:43.106584 2563 scope.go:117] "RemoveContainer" containerID="2ce492e0a891e13a9599d3fd9eff5d06fb8cededece75b87d39c48248f6579a6" Sep 09 23:33:43.106781 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:33:43.106761 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:33:54.187791 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:33:54.187757 2563 scope.go:117] "RemoveContainer" containerID="2ce492e0a891e13a9599d3fd9eff5d06fb8cededece75b87d39c48248f6579a6" Sep 09 23:33:54.188266 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:33:54.187951 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:34:09.187586 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:34:09.187554 2563 scope.go:117] "RemoveContainer" containerID="2ce492e0a891e13a9599d3fd9eff5d06fb8cededece75b87d39c48248f6579a6" Sep 09 23:34:09.187976 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:34:09.187748 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:34:21.187944 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:34:21.187863 2563 scope.go:117] "RemoveContainer" containerID="2ce492e0a891e13a9599d3fd9eff5d06fb8cededece75b87d39c48248f6579a6" Sep 09 23:34:21.188354 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:34:21.188070 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:34:35.187492 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:34:35.187458 2563 scope.go:117] "RemoveContainer" containerID="2ce492e0a891e13a9599d3fd9eff5d06fb8cededece75b87d39c48248f6579a6" Sep 09 23:34:35.187976 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:34:35.187650 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:34:48.193930 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:34:48.193891 2563 scope.go:117] "RemoveContainer" containerID="2ce492e0a891e13a9599d3fd9eff5d06fb8cededece75b87d39c48248f6579a6" Sep 09 23:34:48.194449 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:34:48.194112 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:35:01.187755 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:01.187724 2563 scope.go:117] "RemoveContainer" containerID="2ce492e0a891e13a9599d3fd9eff5d06fb8cededece75b87d39c48248f6579a6" Sep 09 23:35:02.107617 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:02.107583 2563 generic.go:356] "Generic (PLEG): container finished" podID="33885755-289d-4acc-9802-cca8dcf6b20e" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" exitCode=0 Sep 09 23:35:02.107795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:02.107651 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" event={"ID":"33885755-289d-4acc-9802-cca8dcf6b20e","Type":"ContainerDied","Data":"be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510"} Sep 09 23:35:02.107795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:02.107716 2563 scope.go:117] "RemoveContainer" containerID="2ce492e0a891e13a9599d3fd9eff5d06fb8cededece75b87d39c48248f6579a6" Sep 09 23:35:02.108135 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:02.108112 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:35:02.108347 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:35:02.108318 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:35:03.106832 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:03.106798 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:35:03.107217 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:03.106868 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:35:03.107217 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:03.106884 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:35:03.107217 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:03.106901 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:35:03.117838 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:03.117816 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:35:03.118002 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:35:03.117985 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:35:13.187617 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:13.187587 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:35:13.188093 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:35:13.187758 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:35:28.187825 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:28.187792 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:35:28.188263 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:35:28.187953 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:35:43.187724 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:43.187691 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:35:43.188216 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:35:43.187901 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:35:54.187265 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:35:54.187188 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:35:54.187737 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:35:54.187424 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:36:05.187697 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:36:05.187658 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:36:05.188261 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:36:05.187902 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:36:19.187641 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:36:19.187603 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:36:19.188136 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:36:19.187801 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:36:32.188145 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:36:32.188095 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:36:32.188670 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:36:32.188360 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:36:47.187877 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:36:47.187842 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:36:47.188381 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:36:47.188010 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:37:01.187658 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:01.187626 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:37:01.188169 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:37:01.187802 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:37:16.190176 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:16.190141 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:37:16.192639 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:37:16.190396 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:37:17.355947 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:17.355914 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb6f955c9-prftd_857c1282-ccd2-438b-82a6-3bcff8ca60c4/copy-manifests/0.log" Sep 09 23:37:17.361904 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:17.361878 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb6f955c9-prftd_857c1282-ccd2-438b-82a6-3bcff8ca60c4/manager/0.log" Sep 09 23:37:19.523716 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:19.523638 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9l64l_52afc451-0764-4a03-9562-29361eadf19e/istio-proxy/0.log" Sep 09 23:37:19.633057 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:19.633028 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kdhzb_83c04f5e-a43d-46bf-b36b-2e370511ed36/discovery/0.log" Sep 09 23:37:19.952733 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:19.952691 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-knv7q_b70412a9-e7ea-4b97-831b-e3f6e2caf91f/istio-proxy/1.log" Sep 09 23:37:20.058178 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:20.058142 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-g8fzp_02436482-d54e-4e36-a4d5-10f6bf365a70/payload-pre-processing/0.log" Sep 09 23:37:20.161763 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:20.161731 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-mcz5n_c6449c9c-d258-4cc8-b072-552d4c3ce21e/payload-processing/0.log" Sep 09 23:37:20.603146 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:20.603116 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-7xnft_33885755-289d-4acc-9802-cca8dcf6b20e/main/5.log" Sep 09 23:37:21.031666 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:21.031567 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flk4z6_7b1122d9-c34c-491d-abfc-295f58302365/main/0.log" Sep 09 23:37:28.187221 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:28.187174 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:37:28.187697 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:37:28.187455 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:37:29.235102 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:29.235067 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hkq6b_e0d01aef-6642-4f36-841c-4ffbeecd4d46/global-pull-secret-syncer/0.log" Sep 09 23:37:29.356899 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:29.356868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wgbgm_c203b67d-ccdf-4ab8-ae1c-e4fa792dd123/konnectivity-agent/0.log" Sep 09 23:37:29.394018 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:29.393982 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-79.ec2.internal_b05a491c1df21a93085da4fdaf3acb4e/haproxy/0.log" Sep 09 23:37:35.366195 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.366162 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89c7e22d-7a48-490d-9529-8db0bce5e081/alertmanager/0.log" Sep 09 23:37:35.386478 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.386447 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89c7e22d-7a48-490d-9529-8db0bce5e081/config-reloader/0.log" Sep 09 23:37:35.404489 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.404463 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89c7e22d-7a48-490d-9529-8db0bce5e081/kube-rbac-proxy-web/0.log" Sep 09 23:37:35.422397 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.422376 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89c7e22d-7a48-490d-9529-8db0bce5e081/kube-rbac-proxy/0.log" Sep 09 23:37:35.440417 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.440395 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89c7e22d-7a48-490d-9529-8db0bce5e081/kube-rbac-proxy-metric/0.log" Sep 09 23:37:35.462125 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.462100 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89c7e22d-7a48-490d-9529-8db0bce5e081/prom-label-proxy/0.log" Sep 09 23:37:35.481201 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.481179 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89c7e22d-7a48-490d-9529-8db0bce5e081/init-config-reloader/0.log" Sep 09 23:37:35.606322 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.606277 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-747fcc6dd9-zpdnt_34406ed2-9d44-4ea2-a9bf-58c0e0ee3fb1/metrics-server/0.log" Sep 09 23:37:35.668804 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.668712 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7qk78_28391c32-56a2-44d7-8629-5aa7dc4a38cb/node-exporter/0.log" Sep 09 23:37:35.691543 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.691507 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7qk78_28391c32-56a2-44d7-8629-5aa7dc4a38cb/kube-rbac-proxy/0.log" Sep 09 23:37:35.716546 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.716523 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7qk78_28391c32-56a2-44d7-8629-5aa7dc4a38cb/init-textfile/0.log" Sep 09 23:37:35.877873 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.877842 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-rmljm_c81a81f3-158b-4299-8ac9-561a08af5644/kube-rbac-proxy-main/0.log" Sep 09 23:37:35.897829 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.897805 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-rmljm_c81a81f3-158b-4299-8ac9-561a08af5644/kube-rbac-proxy-self/0.log" Sep 09 23:37:35.919272 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:35.919182 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-rmljm_c81a81f3-158b-4299-8ac9-561a08af5644/openshift-state-metrics/0.log" Sep 09 23:37:36.245946 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:36.245920 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cc5d9f758-gm2rq_2133527d-7602-4ddb-a7f2-cc5de484e551/telemeter-client/0.log" Sep 09 23:37:36.298952 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:36.298920 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cc5d9f758-gm2rq_2133527d-7602-4ddb-a7f2-cc5de484e551/reload/0.log" Sep 09 23:37:36.318124 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:36.318094 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cc5d9f758-gm2rq_2133527d-7602-4ddb-a7f2-cc5de484e551/kube-rbac-proxy/0.log" Sep 09 23:37:36.346117 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:36.346089 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687df7cb7b-5hknp_7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9/thanos-query/0.log" Sep 09 23:37:36.366353 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:36.366328 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687df7cb7b-5hknp_7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9/kube-rbac-proxy-web/0.log" Sep 09 23:37:36.386919 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:36.386872 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687df7cb7b-5hknp_7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9/kube-rbac-proxy/0.log" Sep 09 23:37:36.404861 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:36.404833 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687df7cb7b-5hknp_7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9/prom-label-proxy/0.log" Sep 09 23:37:36.423346 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:36.423247 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687df7cb7b-5hknp_7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9/kube-rbac-proxy-rules/0.log" Sep 09 23:37:36.442477 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:36.442448 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687df7cb7b-5hknp_7c3b49ef-bbc0-42f1-ad5b-a7bf07a098e9/kube-rbac-proxy-metrics/0.log" Sep 09 23:37:39.095554 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.095525 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-556d78c84f-z2nrr_a4e47d89-98c7-4642-bad1-002460c7e804/console/0.log" Sep 09 23:37:39.120260 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.120229 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-8wltq_e4d346e3-f06f-4e71-9622-bde8d34fb453/download-server/0.log" Sep 09 23:37:39.295922 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.295885 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf"] Sep 09 23:37:39.299655 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.299632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.302214 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.302186 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vllbr\"/\"kube-root-ca.crt\"" Sep 09 23:37:39.302349 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.302230 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vllbr\"/\"default-dockercfg-x4s7z\"" Sep 09 23:37:39.303194 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.303176 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vllbr\"/\"openshift-service-ca.crt\"" Sep 09 23:37:39.310373 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.310348 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf"] Sep 09 23:37:39.380587 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.380490 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-proc\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.380587 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.380561 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-lib-modules\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.380813 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.380644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-podres\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.380813 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.380699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlsgt\" (UniqueName: \"kubernetes.io/projected/4684eb01-cf8a-4976-9df8-96e1089a8782-kube-api-access-wlsgt\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.380813 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.380750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-sys\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.482104 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.482069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-proc\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.482301 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.482125 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-lib-modules\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.482301 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.482167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-podres\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.482301 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.482199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlsgt\" (UniqueName: \"kubernetes.io/projected/4684eb01-cf8a-4976-9df8-96e1089a8782-kube-api-access-wlsgt\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.482301 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.482218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-sys\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.482301 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.482215 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-proc\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.482301 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.482283 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-sys\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.482565 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.482357 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-podres\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.482565 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.482378 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4684eb01-cf8a-4976-9df8-96e1089a8782-lib-modules\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.489662 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.489630 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlsgt\" (UniqueName: \"kubernetes.io/projected/4684eb01-cf8a-4976-9df8-96e1089a8782-kube-api-access-wlsgt\") pod \"perf-node-gather-daemonset-cwqpf\" (UID: \"4684eb01-cf8a-4976-9df8-96e1089a8782\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.610698 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.610653 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:39.882966 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.882935 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf"] Sep 09 23:37:39.884462 ip-10-0-136-79 kubenswrapper[2563]: W0909 23:37:39.884432 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4684eb01_cf8a_4976_9df8_96e1089a8782.slice/crio-29e5f294988df58ec886e95a1047ab492cc217bc4eff98797636d4cb9a3a36ac WatchSource:0}: Error finding container 29e5f294988df58ec886e95a1047ab492cc217bc4eff98797636d4cb9a3a36ac: Status 404 returned error can't find the container with id 29e5f294988df58ec886e95a1047ab492cc217bc4eff98797636d4cb9a3a36ac Sep 09 23:37:39.977206 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:39.977179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" event={"ID":"4684eb01-cf8a-4976-9df8-96e1089a8782","Type":"ContainerStarted","Data":"29e5f294988df58ec886e95a1047ab492cc217bc4eff98797636d4cb9a3a36ac"} Sep 09 23:37:40.188151 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:40.188056 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:37:40.188627 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:37:40.188251 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:37:40.919071 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:40.919038 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2wczt_86248d06-6829-4b8d-8e18-72fda053ad41/dns/0.log" Sep 09 23:37:40.940264 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:40.940235 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2wczt_86248d06-6829-4b8d-8e18-72fda053ad41/kube-rbac-proxy/0.log" Sep 09 23:37:40.984465 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:40.984430 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" event={"ID":"4684eb01-cf8a-4976-9df8-96e1089a8782","Type":"ContainerStarted","Data":"655ca6888b8af4a513e7e2bc0472ff29b0e47ce3b253e0856c4ec03f37af3c0f"} Sep 09 23:37:40.984635 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:40.984494 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:41.000646 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:41.000598 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" podStartSLOduration=2.000584238 podStartE2EDuration="2.000584238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:37:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:37:40.998210727 +0000 UTC m=+915.290941317" watchObservedRunningTime="2026-09-09 23:37:41.000584238 +0000 UTC m=+915.293314803" Sep 09 23:37:41.083690 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:41.083662 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6qqj6_807e66ae-5942-4115-8fec-ba98c746c881/dns-node-resolver/0.log" Sep 09 23:37:41.560763 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:41.560733 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c9898c6f4-qxcsd_4ab3e715-dcbf-4db3-8b76-549541573136/registry/0.log" Sep 09 23:37:41.605918 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:41.605892 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kmnm2_2ccf608c-06db-4253-bab5-c1ee922617a0/node-ca/0.log" Sep 09 23:37:42.526862 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:42.526834 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9l64l_52afc451-0764-4a03-9562-29361eadf19e/istio-proxy/0.log" Sep 09 23:37:42.569721 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:42.569691 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kdhzb_83c04f5e-a43d-46bf-b36b-2e370511ed36/discovery/0.log" Sep 09 23:37:42.636932 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:42.636900 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-knv7q_b70412a9-e7ea-4b97-831b-e3f6e2caf91f/istio-proxy/1.log" Sep 09 23:37:42.637332 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:42.637295 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-knv7q_b70412a9-e7ea-4b97-831b-e3f6e2caf91f/istio-proxy/0.log" Sep 09 23:37:42.655273 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:42.655249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-g8fzp_02436482-d54e-4e36-a4d5-10f6bf365a70/payload-pre-processing/0.log" Sep 09 23:37:42.679700 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:42.679676 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-mcz5n_c6449c9c-d258-4cc8-b072-552d4c3ce21e/payload-processing/0.log" Sep 09 23:37:43.375534 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:43.375502 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f4xtd_7814455e-89ca-49a3-ba29-f6048db57aef/serve-healthcheck-canary/0.log" Sep 09 23:37:43.963980 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:43.963949 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbxzx_4b0958fe-427f-436e-9e5e-34b5281ae880/kube-rbac-proxy/0.log" Sep 09 23:37:43.981285 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:43.981257 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbxzx_4b0958fe-427f-436e-9e5e-34b5281ae880/exporter/0.log" Sep 09 23:37:43.999678 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:43.999654 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbxzx_4b0958fe-427f-436e-9e5e-34b5281ae880/extractor/0.log" Sep 09 23:37:46.278433 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:46.278401 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb6f955c9-prftd_857c1282-ccd2-438b-82a6-3bcff8ca60c4/manager/0.log" Sep 09 23:37:46.298511 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:46.298487 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb6f955c9-prftd_857c1282-ccd2-438b-82a6-3bcff8ca60c4/copy-manifests/0.log" Sep 09 23:37:47.001373 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:47.001345 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-cwqpf" Sep 09 23:37:47.395402 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:47.395374 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b488669bf-7qnxb_4d000f59-f117-4a2d-91cf-0531d27a6ed2/manager/0.log" Sep 09 23:37:49.065434 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:49.065403 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9l64l_52afc451-0764-4a03-9562-29361eadf19e/istio-proxy/0.log" Sep 09 23:37:49.115428 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:49.115386 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kdhzb_83c04f5e-a43d-46bf-b36b-2e370511ed36/discovery/0.log" Sep 09 23:37:49.167155 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:49.167121 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-knv7q_b70412a9-e7ea-4b97-831b-e3f6e2caf91f/istio-proxy/1.log" Sep 09 23:37:49.167597 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:49.167573 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-knv7q_b70412a9-e7ea-4b97-831b-e3f6e2caf91f/istio-proxy/0.log" Sep 09 23:37:49.178566 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:49.178541 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-g8fzp_02436482-d54e-4e36-a4d5-10f6bf365a70/payload-pre-processing/0.log" Sep 09 23:37:49.192801 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:49.192769 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-mcz5n_c6449c9c-d258-4cc8-b072-552d4c3ce21e/payload-processing/0.log" Sep 09 23:37:50.494201 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:50.494179 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9l64l_52afc451-0764-4a03-9562-29361eadf19e/istio-proxy/0.log" Sep 09 23:37:50.531827 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:50.531744 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kdhzb_83c04f5e-a43d-46bf-b36b-2e370511ed36/discovery/0.log" Sep 09 23:37:50.579467 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:50.579423 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-knv7q_b70412a9-e7ea-4b97-831b-e3f6e2caf91f/istio-proxy/1.log" Sep 09 23:37:50.579970 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:50.579954 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-knv7q_b70412a9-e7ea-4b97-831b-e3f6e2caf91f/istio-proxy/0.log" Sep 09 23:37:50.597174 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:50.597146 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-g8fzp_02436482-d54e-4e36-a4d5-10f6bf365a70/payload-pre-processing/0.log" Sep 09 23:37:50.610966 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:50.610940 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-mcz5n_c6449c9c-d258-4cc8-b072-552d4c3ce21e/payload-processing/0.log" Sep 09 23:37:51.187522 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:51.187493 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:37:51.187795 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:51.187782 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:37:52.047471 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:52.047429 2563 generic.go:356] "Generic (PLEG): container finished" podID="33885755-289d-4acc-9802-cca8dcf6b20e" containerID="68ba7f4519c2f619b1c902364ee0cff0bd50423143e4fbe31733f939d9cf6351" exitCode=0 Sep 09 23:37:52.047900 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:52.047500 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" event={"ID":"33885755-289d-4acc-9802-cca8dcf6b20e","Type":"ContainerDied","Data":"68ba7f4519c2f619b1c902364ee0cff0bd50423143e4fbe31733f939d9cf6351"} Sep 09 23:37:52.047900 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:52.047561 2563 scope.go:117] "RemoveContainer" containerID="be1add01a1a6ddb2474bcf9fc9069f83614df04c77df286a121c99b6ae328510" Sep 09 23:37:52.047900 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:52.047851 2563 scope.go:117] "RemoveContainer" containerID="68ba7f4519c2f619b1c902364ee0cff0bd50423143e4fbe31733f939d9cf6351" Sep 09 23:37:52.048098 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:37:52.048079 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:37:53.106633 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:53.106599 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:37:53.107016 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:53.106664 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:37:53.107016 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:53.106681 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:37:53.107016 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:53.106694 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" Sep 09 23:37:53.107120 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:53.107056 2563 scope.go:117] "RemoveContainer" containerID="68ba7f4519c2f619b1c902364ee0cff0bd50423143e4fbe31733f939d9cf6351" Sep 09 23:37:53.107271 ip-10-0-136-79 kubenswrapper[2563]: E0909 23:37:53.107250 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7xnft_llm(33885755-289d-4acc-9802-cca8dcf6b20e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7xnft" podUID="33885755-289d-4acc-9802-cca8dcf6b20e" Sep 09 23:37:54.145811 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:54.145775 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5vgg9_97fc02db-0c12-40dd-b385-ddc20d26adea/kube-multus/0.log" Sep 09 23:37:54.505963 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:54.505887 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpqb4_5094299e-d554-41d2-938d-d5ba8c6559ac/kube-multus-additional-cni-plugins/0.log" Sep 09 23:37:54.531299 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:54.531273 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpqb4_5094299e-d554-41d2-938d-d5ba8c6559ac/egress-router-binary-copy/0.log" Sep 09 23:37:54.551654 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:54.551629 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpqb4_5094299e-d554-41d2-938d-d5ba8c6559ac/cni-plugins/0.log" Sep 09 23:37:54.571734 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:54.571705 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpqb4_5094299e-d554-41d2-938d-d5ba8c6559ac/bond-cni-plugin/0.log" Sep 09 23:37:54.589763 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:54.589736 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpqb4_5094299e-d554-41d2-938d-d5ba8c6559ac/routeoverride-cni/0.log" Sep 09 23:37:54.607460 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:54.607433 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpqb4_5094299e-d554-41d2-938d-d5ba8c6559ac/whereabouts-cni-bincopy/0.log" Sep 09 23:37:54.625217 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:54.625197 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpqb4_5094299e-d554-41d2-938d-d5ba8c6559ac/whereabouts-cni/0.log" Sep 09 23:37:54.720101 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:54.720070 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7cdh4_b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c/network-metrics-daemon/0.log" Sep 09 23:37:54.736279 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:54.736250 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7cdh4_b5c1d9fb-eb5e-4330-89ff-33ae88e4df0c/kube-rbac-proxy/0.log" Sep 09 23:37:55.891045 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:55.891018 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2rnn_2357acc3-05fe-4e3b-92a7-7285db060886/ovn-controller/0.log" Sep 09 23:37:55.906508 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:55.906483 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2rnn_2357acc3-05fe-4e3b-92a7-7285db060886/ovn-acl-logging/0.log" Sep 09 23:37:55.926006 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:55.925983 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2rnn_2357acc3-05fe-4e3b-92a7-7285db060886/kube-rbac-proxy-node/0.log" Sep 09 23:37:55.943832 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:55.943810 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2rnn_2357acc3-05fe-4e3b-92a7-7285db060886/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 23:37:55.960930 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:55.960908 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2rnn_2357acc3-05fe-4e3b-92a7-7285db060886/northd/0.log" Sep 09 23:37:55.979003 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:55.978983 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2rnn_2357acc3-05fe-4e3b-92a7-7285db060886/nbdb/0.log" Sep 09 23:37:55.996526 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:55.996497 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2rnn_2357acc3-05fe-4e3b-92a7-7285db060886/sbdb/0.log" Sep 09 23:37:56.032292 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:56.032264 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2rnn_2357acc3-05fe-4e3b-92a7-7285db060886/ovnkube-controller/0.log" Sep 09 23:37:57.117279 ip-10-0-136-79 kubenswrapper[2563]: I0909 23:37:57.117251 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pvbp9_d12e593f-3c8d-43b4-91de-74e053cfbf13/network-check-target-container/0.log"